2024-04-15 05:52:47,653 DEBUG [main] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-04-15 05:52:47,803 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.ipc.TestBlockingIPC timeout: 13 mins 2024-04-15 05:52:47,831 INFO [Time-limited test] hbase.ResourceChecker(147): before: ipc.TestBlockingIPC#testRTEDuringConnectionSetup Thread=10, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=294, ProcessCount=182, AvailableMemoryMB=3651 2024-04-15 05:52:47,991 INFO [Time-limited test] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.SimpleRpcServer hosting hbase.test.pb.TestProtobufRpcProto 2024-04-15 05:52:48,201 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-04-15 05:52:48,296 INFO [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-04-15 05:52:48,331 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-04-15 05:52:48,458 INFO [Time-limited test] ipc.SimpleRpcServer$Listener(134): testRpcServer: started 3 reader(s) listening on port=37887 2024-04-15 05:52:48,549 DEBUG [Time-limited test] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f62932c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-15 05:52:48,557 DEBUG [RpcServer.responder] ipc.SimpleRpcServerResponder(58): RpcServer.responder: starting 2024-04-15 05:52:48,558 INFO [Listener,port=37887] ipc.SimpleRpcServer$Listener(214): Listener,port=37887: starting 2024-04-15 05:52:48,558 INFO [Time-limited test] ipc.FifoRpcScheduler(61): Using FifoRpcScheduler as user call queue; handlerCount=1; maxQueueLength=10 2024-04-15 05:52:48,868 DEBUG [Time-limited test] ipc.RpcConnection(122): Using SIMPLE authentication for service=TestProtobufRpcProto, sasl=false 2024-04-15 05:52:48,943 DEBUG [Time-limited test] ipc.BlockingRpcConnection(501): Connecting to localhost:37887 2024-04-15 05:52:48,946 DEBUG [Time-limited test] ipc.FailedServers(52): Added failed server with address localhost:37887 to list caused by java.lang.RuntimeException: Injected fault 2024-04-15 05:52:48,947 DEBUG [Time-limited test] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:52:48,947 INFO [Time-limited test] ipc.AbstractTestIPC(171): Caught expected exception: org.apache.hbase.thirdparty.com.google.protobuf.ServiceException: java.io.IOException: Call to address=localhost:37887 failed on local exception: java.io.IOException: Could not set up IO Streams to localhost:37887 2024-04-15 05:52:48,947 INFO [Time-limited test] ipc.SimpleRpcServer(438): Stopping server on 37887 2024-04-15 05:52:48,948 INFO [Listener,port=37887] ipc.SimpleRpcServer$Listener(258): Listener,port=37887: stopping 2024-04-15 05:52:48,948 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(158): RpcServer.responder: stopped 2024-04-15 05:52:48,948 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(62): RpcServer.responder: stopping 2024-04-15 05:52:48,957 INFO [Time-limited test] hbase.ResourceChecker(175): after: ipc.TestBlockingIPC#testRTEDuringConnectionSetup Thread=13 (was 10) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=291 (was 290) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=294 (was 294), ProcessCount=182 (was 182), AvailableMemoryMB=3289 (was 3651) 2024-04-15 05:52:48,966 INFO [Time-limited test] hbase.ResourceChecker(147): before: ipc.TestBlockingIPC#testTimeout Thread=13, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=294, ProcessCount=182, AvailableMemoryMB=3286 2024-04-15 05:52:48,967 INFO [Time-limited test] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.SimpleRpcServer hosting hbase.test.pb.TestProtobufRpcProto 2024-04-15 05:52:48,968 INFO [Time-limited test] ipc.SimpleRpcServer$Listener(134): testRpcServer: started 3 reader(s) listening on port=38281 2024-04-15 05:52:48,969 DEBUG [Time-limited test] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44498cec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-15 05:52:48,969 DEBUG [RpcServer.responder] ipc.SimpleRpcServerResponder(58): RpcServer.responder: starting 2024-04-15 05:52:48,969 INFO [Time-limited test] ipc.FifoRpcScheduler(61): Using FifoRpcScheduler as user call queue; handlerCount=1; maxQueueLength=10 2024-04-15 05:52:48,969 INFO [Listener,port=38281] ipc.SimpleRpcServer$Listener(214): Listener,port=38281: starting 2024-04-15 05:52:48,972 DEBUG [Time-limited test] ipc.RpcConnection(122): Using SIMPLE authentication for service=TestProtobufRpcProto, sasl=false 2024-04-15 05:52:48,976 DEBUG [Time-limited test] ipc.BlockingRpcConnection(501): Connecting to localhost:38281 2024-04-15 05:52:48,998 INFO [Reader=1,bindAddress=localhost,port=38281] ipc.ServerRpcConnection(540): Connection from 127.0.0.1:37602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=TestProtobufRpcProto 2024-04-15 05:52:49,091 INFO [Time-limited test] ipc.AbstractTestIPC(293): Caught expected exception: org.apache.hbase.thirdparty.com.google.protobuf.ServiceException: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:38281 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=0,methodName=pause], waitTime=119ms, rpcTimeout=100ms 2024-04-15 05:52:49,195 INFO [Time-limited test] ipc.AbstractTestIPC(293): Caught expected exception: org.apache.hbase.thirdparty.com.google.protobuf.ServiceException: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:38281 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=1,methodName=pause], waitTime=104ms, rpcTimeout=100ms 2024-04-15 05:52:49,305 INFO [Time-limited test] ipc.AbstractTestIPC(293): Caught expected exception: org.apache.hbase.thirdparty.com.google.protobuf.ServiceException: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:38281 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=2,methodName=pause], waitTime=110ms, rpcTimeout=100ms 2024-04-15 05:52:49,416 INFO [Time-limited test] ipc.AbstractTestIPC(293): Caught expected exception: org.apache.hbase.thirdparty.com.google.protobuf.ServiceException: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:38281 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=3,methodName=pause], waitTime=109ms, rpcTimeout=100ms 2024-04-15 05:52:49,525 INFO [Time-limited test] ipc.AbstractTestIPC(293): Caught expected exception: org.apache.hbase.thirdparty.com.google.protobuf.ServiceException: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:38281 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=4,methodName=pause], waitTime=109ms, rpcTimeout=100ms 2024-04-15 05:52:49,635 INFO [Time-limited test] ipc.AbstractTestIPC(293): Caught expected exception: org.apache.hbase.thirdparty.com.google.protobuf.ServiceException: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:38281 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=5,methodName=pause], waitTime=110ms, rpcTimeout=100ms 2024-04-15 05:52:49,745 INFO [Time-limited test] ipc.AbstractTestIPC(293): Caught expected exception: org.apache.hbase.thirdparty.com.google.protobuf.ServiceException: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:38281 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=6,methodName=pause], waitTime=110ms, rpcTimeout=100ms 2024-04-15 05:52:49,856 INFO [Time-limited test] ipc.AbstractTestIPC(293): Caught expected exception: org.apache.hbase.thirdparty.com.google.protobuf.ServiceException: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:38281 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=7,methodName=pause], waitTime=110ms, rpcTimeout=100ms 2024-04-15 05:52:49,965 INFO [Time-limited test] ipc.AbstractTestIPC(293): Caught expected exception: org.apache.hbase.thirdparty.com.google.protobuf.ServiceException: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:38281 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=8,methodName=pause], waitTime=109ms, rpcTimeout=100ms 2024-04-15 05:52:50,028 DEBUG [BRPC Connection (86992864) to localhost:38281 from jenkins (attempt: 1)] ipc.BlockingRpcConnection(742): Unknown callId: 0, skipping over this response of 1 bytes 2024-04-15 05:52:50,040 WARN [FifoRpcScheduler.handler-pool-0] ipc.CallRunner(105): Dropping timed out call: callId: 1 service: TestProtobufRpcProto methodName: pause size: 20 connection: 127.0.0.1:37602 deadline: 1713160369192 param: TODO: class org.apache.hadoop.hbase.shaded.ipc.protobuf.generated.TestProtos$PauseRequestProto connection: 127.0.0.1:37602 2024-04-15 05:52:50,041 WARN [FifoRpcScheduler.handler-pool-0] ipc.CallRunner(105): Dropping timed out call: callId: 2 service: TestProtobufRpcProto methodName: pause size: 20 connection: 127.0.0.1:37602 deadline: 1713160369296 param: TODO: class org.apache.hadoop.hbase.shaded.ipc.protobuf.generated.TestProtos$PauseRequestProto connection: 127.0.0.1:37602 2024-04-15 05:52:50,041 WARN [FifoRpcScheduler.handler-pool-0] ipc.CallRunner(105): Dropping timed out call: callId: 3 service: TestProtobufRpcProto methodName: pause size: 20 connection: 127.0.0.1:37602 deadline: 1713160369406 param: TODO: class org.apache.hadoop.hbase.shaded.ipc.protobuf.generated.TestProtos$PauseRequestProto connection: 127.0.0.1:37602 2024-04-15 05:52:50,041 WARN [FifoRpcScheduler.handler-pool-0] ipc.CallRunner(105): Dropping timed out call: callId: 4 service: TestProtobufRpcProto methodName: pause size: 20 connection: 127.0.0.1:37602 deadline: 1713160369516 param: TODO: class org.apache.hadoop.hbase.shaded.ipc.protobuf.generated.TestProtos$PauseRequestProto connection: 127.0.0.1:37602 2024-04-15 05:52:50,041 WARN [FifoRpcScheduler.handler-pool-0] ipc.CallRunner(105): Dropping timed out call: callId: 5 service: TestProtobufRpcProto methodName: pause size: 20 connection: 127.0.0.1:37602 deadline: 1713160369626 param: TODO: class org.apache.hadoop.hbase.shaded.ipc.protobuf.generated.TestProtos$PauseRequestProto connection: 127.0.0.1:37602 2024-04-15 05:52:50,042 WARN [FifoRpcScheduler.handler-pool-0] ipc.CallRunner(105): Dropping timed out call: callId: 6 service: TestProtobufRpcProto methodName: pause size: 20 connection: 127.0.0.1:37602 deadline: 1713160369736 param: TODO: class org.apache.hadoop.hbase.shaded.ipc.protobuf.generated.TestProtos$PauseRequestProto connection: 127.0.0.1:37602 2024-04-15 05:52:50,042 WARN [FifoRpcScheduler.handler-pool-0] ipc.CallRunner(105): Dropping timed out call: callId: 7 service: TestProtobufRpcProto methodName: pause size: 20 connection: 127.0.0.1:37602 deadline: 1713160369846 param: TODO: class org.apache.hadoop.hbase.shaded.ipc.protobuf.generated.TestProtos$PauseRequestProto connection: 127.0.0.1:37602 2024-04-15 05:52:50,042 WARN [FifoRpcScheduler.handler-pool-0] ipc.CallRunner(105): Dropping timed out call: callId: 8 service: TestProtobufRpcProto methodName: pause size: 20 connection: 127.0.0.1:37602 deadline: 1713160369957 param: TODO: class org.apache.hadoop.hbase.shaded.ipc.protobuf.generated.TestProtos$PauseRequestProto connection: 127.0.0.1:37602 2024-04-15 05:52:50,075 INFO [Time-limited test] ipc.AbstractTestIPC(293): Caught expected exception: org.apache.hbase.thirdparty.com.google.protobuf.ServiceException: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:38281 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=9,methodName=pause], waitTime=110ms, rpcTimeout=100ms 2024-04-15 05:52:50,075 DEBUG [Time-limited test] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:52:50,076 INFO [Time-limited test] ipc.SimpleRpcServer(438): Stopping server on 38281 2024-04-15 05:52:50,077 INFO [Listener,port=38281] ipc.SimpleRpcServer$Listener(258): Listener,port=38281: stopping 2024-04-15 05:52:50,077 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(158): RpcServer.responder: stopped 2024-04-15 05:52:50,078 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(62): RpcServer.responder: stopping 2024-04-15 05:52:50,092 INFO [Time-limited test] hbase.ResourceChecker(175): after: ipc.TestBlockingIPC#testTimeout Thread=18 (was 13) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Reader=1,bindAddress=localhost,port=38281 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: FifoRpcScheduler.handler-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.util.Threads.sleepWithoutInterrupt(Threads.java:152) org.apache.hadoop.hbase.ipc.TestProtobufRpcServiceImpl.pause(TestProtobufRpcServiceImpl.java:110) org.apache.hadoop.hbase.shaded.ipc.protobuf.generated.TestRpcServiceProtos$TestProtobufRpcProto$2.callBlockingMethod(TestRpcServiceProtos.java:144) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:113) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.responder java.nio.charset.CharsetEncoder.(CharsetEncoder.java:233) sun.nio.cs.UTF_8$Encoder.(UTF_8.java:558) sun.nio.cs.UTF_8$Encoder.(UTF_8.java:554) sun.nio.cs.UTF_8.newEncoder(UTF_8.java:72) org.apache.maven.surefire.booter.stream.EventEncoder.newCharsetEncoder(EventEncoder.java:69) org.apache.maven.surefire.booter.spi.EventChannelEncoder.encodeMessage(EventChannelEncoder.java:375) org.apache.maven.surefire.booter.spi.EventChannelEncoder.setOutErr(EventChannelEncoder.java:172) org.apache.maven.surefire.booter.spi.EventChannelEncoder.testOutput(EventChannelEncoder.java:168) org.apache.maven.surefire.api.booter.ForkingRunListener.writeTestOutput(ForkingRunListener.java:99) org.apache.maven.surefire.api.booter.ForkingRunListener.writeTestOutput(ForkingRunListener.java:43) org.apache.maven.surefire.common.junit4.JUnit4RunListener.writeTestOutput(JUnit4RunListener.java:202) org.apache.maven.surefire.api.report.ConsoleOutputCapture$ForwardingPrintStream.write(ConsoleOutputCapture.java:57) sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221) sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291) sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295) sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141) java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229) org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:54) org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:317) org.apache.log4j.WriterAppender.append(WriterAppender.java:156) org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:232) org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:57) org.apache.log4j.Category.callAppenders(Category.java:206) org.apache.log4j.Category.forcedLog(Category.java:384) org.apache.log4j.Category.log(Category.java:810) org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284) org.apache.hadoop.hbase.ipc.SimpleRpcServerResponder.run(SimpleRpcServerResponder.java:62) - Thread LEAK? -, OpenFileDescriptor=294 (was 291) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 294), ProcessCount=180 (was 182), AvailableMemoryMB=3119 (was 3286) 2024-04-15 05:52:50,106 INFO [Time-limited test] hbase.ResourceChecker(147): before: ipc.TestBlockingIPC#testRpcScheduler Thread=16, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=278, ProcessCount=180, AvailableMemoryMB=3119 2024-04-15 05:52:50,711 INFO [Time-limited test] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.SimpleRpcServer hosting hbase.test.pb.TestProtobufRpcProto 2024-04-15 05:52:50,715 INFO [Time-limited test] ipc.SimpleRpcServer$Listener(134): testRpcServer: started 3 reader(s) listening on port=36655 2024-04-15 05:52:50,750 DEBUG [Time-limited test] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7158fa82, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-15 05:52:50,750 DEBUG [RpcServer.responder] ipc.SimpleRpcServerResponder(58): RpcServer.responder: starting 2024-04-15 05:52:50,754 INFO [Listener,port=36655] ipc.SimpleRpcServer$Listener(214): Listener,port=36655: starting 2024-04-15 05:52:50,755 INFO [Time-limited test] ipc.FifoRpcScheduler(61): Using FifoRpcScheduler$MockitoMock$835881522 as user call queue; handlerCount=1; maxQueueLength=10 2024-04-15 05:52:50,762 DEBUG [Time-limited test] ipc.RpcConnection(122): Using SIMPLE authentication for service=TestProtobufRpcProto, sasl=false 2024-04-15 05:52:50,763 DEBUG [Time-limited test] ipc.BlockingRpcConnection(501): Connecting to localhost:36655 2024-04-15 05:52:50,765 INFO [Reader=1,bindAddress=localhost,port=36655] ipc.ServerRpcConnection(540): Connection from 127.0.0.1:57154, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=TestProtobufRpcProto 2024-04-15 05:52:50,786 DEBUG [Time-limited test] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:52:50,786 INFO [Time-limited test] ipc.SimpleRpcServer(438): Stopping server on 36655 2024-04-15 05:52:50,786 DEBUG [BRPC Connection (86992864) to localhost:36655 from jenkins (attempt: 1)] ipc.BlockingRpcConnection(369): Interrupted while waiting for work 2024-04-15 05:52:50,786 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(158): RpcServer.responder: stopped 2024-04-15 05:52:50,787 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(62): RpcServer.responder: stopping 2024-04-15 05:52:50,787 INFO [Listener,port=36655] ipc.SimpleRpcServer$Listener(258): Listener,port=36655: stopping 2024-04-15 05:52:50,800 INFO [Time-limited test] hbase.ResourceChecker(175): after: ipc.TestBlockingIPC#testRpcScheduler Thread=22 (was 16) Potentially hanging thread: BRPC Connection (86992864) to localhost:36655 from jenkins (attempt: 1) org.apache.log4j.Logger.isTraceEnabled(Logger.java:199) org.slf4j.impl.Reload4jLoggerAdapter.isTraceEnabled(Reload4jLoggerAdapter.java:83) org.apache.hadoop.hbase.ipc.BlockingRpcConnection.run(BlockingRpcConnection.java:396) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.responder java.lang.Thread.isInterrupted(Native Method) java.lang.Thread.interrupted(Thread.java:952) org.apache.maven.surefire.booter.spi.EventChannelEncoder.write(EventChannelEncoder.java:286) org.apache.maven.surefire.booter.spi.EventChannelEncoder.setOutErr(EventChannelEncoder.java:173) org.apache.maven.surefire.booter.spi.EventChannelEncoder.testOutput(EventChannelEncoder.java:168) org.apache.maven.surefire.api.booter.ForkingRunListener.writeTestOutput(ForkingRunListener.java:99) org.apache.maven.surefire.api.booter.ForkingRunListener.writeTestOutput(ForkingRunListener.java:43) org.apache.maven.surefire.common.junit4.JUnit4RunListener.writeTestOutput(JUnit4RunListener.java:202) org.apache.maven.surefire.api.report.ConsoleOutputCapture$ForwardingPrintStream.write(ConsoleOutputCapture.java:57) sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221) sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291) sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295) sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141) java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229) org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:54) org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:317) org.apache.log4j.WriterAppender.append(WriterAppender.java:156) org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:232) org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:57) org.apache.log4j.Category.callAppenders(Category.java:206) org.apache.log4j.Category.forcedLog(Category.java:384) org.apache.log4j.Category.log(Category.java:810) org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284) org.apache.hadoop.hbase.ipc.SimpleRpcServerResponder.run(SimpleRpcServerResponder.java:62) Potentially hanging thread: RpcServer idle connection scanner for port 36655 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Listener,port=36655 org.apache.log4j.Category.callAppenders(Category.java:205) org.apache.log4j.Category.forcedLog(Category.java:384) org.apache.log4j.Category.log(Category.java:810) org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284) org.apache.hadoop.hbase.ipc.SimpleRpcServer$Listener.run(SimpleRpcServer.java:258) Potentially hanging thread: Reader=2,bindAddress=localhost,port=36655 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hadoop.hbase.ipc.SimpleRpcServer$Listener$Reader.doRunLoop(SimpleRpcServer.java:174) org.apache.hadoop.hbase.ipc.SimpleRpcServer$Listener$Reader.run(SimpleRpcServer.java:154) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=300 (was 294) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 278), ProcessCount=182 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=3011 (was 3119) 2024-04-15 05:52:50,814 INFO [Time-limited test] hbase.ResourceChecker(147): before: ipc.TestBlockingIPC#testAsyncRemoteError Thread=16, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=278, ProcessCount=183, AvailableMemoryMB=3009 2024-04-15 05:52:50,814 DEBUG [Time-limited test] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cbdedc4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-15 05:52:50,815 INFO [Time-limited test] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.SimpleRpcServer hosting hbase.test.pb.TestProtobufRpcProto 2024-04-15 05:52:50,817 INFO [Time-limited test] ipc.SimpleRpcServer$Listener(134): testRpcServer: started 3 reader(s) listening on port=35513 2024-04-15 05:52:50,817 DEBUG [RpcServer.responder] ipc.SimpleRpcServerResponder(58): RpcServer.responder: starting 2024-04-15 05:52:50,817 INFO [Time-limited test] ipc.FifoRpcScheduler(61): Using FifoRpcScheduler as user call queue; handlerCount=1; maxQueueLength=10 2024-04-15 05:52:50,817 INFO [Listener,port=35513] ipc.SimpleRpcServer$Listener(214): Listener,port=35513: starting 2024-04-15 05:52:50,820 DEBUG [Time-limited test] ipc.RpcConnection(122): Using SIMPLE authentication for service=TestProtobufRpcProto, sasl=false 2024-04-15 05:52:50,821 DEBUG [Time-limited test] ipc.BlockingRpcConnection(501): Connecting to localhost:35513 2024-04-15 05:52:50,823 INFO [Reader=1,bindAddress=localhost,port=35513] ipc.ServerRpcConnection(540): Connection from 127.0.0.1:36024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=TestProtobufRpcProto 2024-04-15 05:52:50,841 DEBUG [FifoRpcScheduler.handler-pool-0] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.DoNotRetryIOException: server error! at org.apache.hadoop.hbase.ipc.TestProtobufRpcServiceImpl.error(TestProtobufRpcServiceImpl.java:104) at org.apache.hadoop.hbase.shaded.ipc.protobuf.generated.TestRpcServiceProtos$TestProtobufRpcProto$2.callBlockingMethod(TestRpcServiceProtos.java:142) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:113) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-04-15 05:52:50,842 DEBUG [FifoRpcScheduler.handler-pool-0] ipc.CallRunner(144): callId: 0 service: TestProtobufRpcProto methodName: error size: 17 connection: 127.0.0.1:36024 deadline: 9223372036854775807, exception=org.apache.hadoop.hbase.DoNotRetryIOException: server error! 2024-04-15 05:52:50,846 INFO [Time-limited test] ipc.AbstractTestIPC(374): Caught expected exception: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException): org.apache.hadoop.hbase.DoNotRetryIOException: server error! at org.apache.hadoop.hbase.ipc.TestProtobufRpcServiceImpl.error(TestProtobufRpcServiceImpl.java:104) at org.apache.hadoop.hbase.shaded.ipc.protobuf.generated.TestRpcServiceProtos$TestProtobufRpcProto$2.callBlockingMethod(TestRpcServiceProtos.java:142) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:113) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-04-15 05:52:51,043 DEBUG [FifoRpcScheduler.handler-pool-0] ipc.SimpleRpcServerResponder(238): 127.0.0.1:37602: output error -- closing 2024-04-15 05:52:51,043 WARN [FifoRpcScheduler.handler-pool-0] ipc.CallRunner(181): FifoRpcScheduler.handler-pool-0: caught a ClosedChannelException, this means that the server localhost/127.0.0.1:38281 was processing a request but the client went away. The error message was: null 2024-04-15 05:52:51,204 DEBUG [Time-limited test] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:52:51,205 INFO [Time-limited test] ipc.SimpleRpcServer(438): Stopping server on 35513 2024-04-15 05:52:51,205 DEBUG [BRPC Connection (86992864) to localhost:35513 from jenkins (attempt: 1)] ipc.BlockingRpcConnection(369): Interrupted while waiting for work 2024-04-15 05:52:51,205 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(158): RpcServer.responder: stopped 2024-04-15 05:52:51,205 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(62): RpcServer.responder: stopping 2024-04-15 05:52:51,205 INFO [Listener,port=35513] ipc.SimpleRpcServer$Listener(258): Listener,port=35513: stopping 2024-04-15 05:52:51,215 INFO [Time-limited test] hbase.ResourceChecker(175): after: ipc.TestBlockingIPC#testAsyncRemoteError Thread=16 (was 16), OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 278), ProcessCount=182 (was 183), AvailableMemoryMB=2923 (was 3009) 2024-04-15 05:52:51,224 INFO [Time-limited test] hbase.ResourceChecker(147): before: ipc.TestBlockingIPC#testAsyncEcho Thread=16, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=278, ProcessCount=183, AvailableMemoryMB=2921 2024-04-15 05:52:51,242 INFO [Time-limited test] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.SimpleRpcServer hosting hbase.test.pb.TestProtobufRpcProto 2024-04-15 05:52:51,244 INFO [Time-limited test] ipc.SimpleRpcServer$Listener(134): testRpcServer: started 3 reader(s) listening on port=37767 2024-04-15 05:52:51,244 DEBUG [Time-limited test] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@359a2938, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-15 05:52:51,244 DEBUG [RpcServer.responder] ipc.SimpleRpcServerResponder(58): RpcServer.responder: starting 2024-04-15 05:52:51,245 INFO [Time-limited test] ipc.FifoRpcScheduler(61): Using FifoRpcScheduler as user call queue; handlerCount=1; maxQueueLength=10 2024-04-15 05:52:51,245 INFO [Listener,port=37767] ipc.SimpleRpcServer$Listener(214): Listener,port=37767: starting 2024-04-15 05:52:51,245 DEBUG [Time-limited test] ipc.RpcConnection(122): Using SIMPLE authentication for service=TestProtobufRpcProto, sasl=false 2024-04-15 05:52:51,246 DEBUG [Time-limited test] ipc.BlockingRpcConnection(501): Connecting to localhost:37767 2024-04-15 05:52:51,247 INFO [Reader=1,bindAddress=localhost,port=37767] ipc.ServerRpcConnection(540): Connection from 127.0.0.1:51070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=TestProtobufRpcProto 2024-04-15 05:52:51,259 DEBUG [Time-limited test] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:52:51,262 INFO [Time-limited test] ipc.SimpleRpcServer(438): Stopping server on 37767 2024-04-15 05:52:51,262 DEBUG [BRPC Connection (86992864) to localhost:37767 from jenkins (attempt: 1)] ipc.BlockingRpcConnection(369): Interrupted while waiting for work 2024-04-15 05:52:51,262 INFO [Listener,port=37767] ipc.SimpleRpcServer$Listener(258): Listener,port=37767: stopping 2024-04-15 05:52:51,263 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(158): RpcServer.responder: stopped 2024-04-15 05:52:51,263 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(62): RpcServer.responder: stopping 2024-04-15 05:52:51,277 INFO [Time-limited test] hbase.ResourceChecker(175): after: ipc.TestBlockingIPC#testAsyncEcho Thread=18 (was 16) Potentially hanging thread: Listener,port=37767 org.apache.hadoop.hbase.ipc.SimpleRpcServer$Listener.run(SimpleRpcServer.java:261) Potentially hanging thread: RpcServer idle connection scanner for port 37767 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 278), ProcessCount=184 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2920 (was 2921) 2024-04-15 05:52:51,285 INFO [Time-limited test] hbase.ResourceChecker(147): before: ipc.TestBlockingIPC#testConnectionCloseWithOutstandingRPCs Thread=16, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=278, ProcessCount=184, AvailableMemoryMB=2918 2024-04-15 05:52:51,287 INFO [Time-limited test] ipc.SimpleRpcServer$Listener(134): testRpcServer: started 3 reader(s) listening on port=34039 2024-04-15 05:52:51,288 DEBUG [Time-limited test] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1af77779, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-15 05:52:51,289 INFO [Time-limited test] ipc.FifoRpcScheduler(61): Using FifoRpcScheduler as user call queue; handlerCount=1; maxQueueLength=10 2024-04-15 05:52:51,289 INFO [Listener,port=34039] ipc.SimpleRpcServer$Listener(214): Listener,port=34039: starting 2024-04-15 05:52:51,289 DEBUG [RpcServer.responder] ipc.SimpleRpcServerResponder(58): RpcServer.responder: starting 2024-04-15 05:52:51,290 DEBUG [Time-limited test] ipc.RpcConnection(122): Using SIMPLE authentication for service=TestProtobufRpcProto, sasl=false 2024-04-15 05:52:51,290 DEBUG [Time-limited test] ipc.BlockingRpcConnection(501): Connecting to localhost:34039 2024-04-15 05:52:51,292 INFO [Reader=1,bindAddress=localhost,port=34039] ipc.ServerRpcConnection(540): Connection from 127.0.0.1:57008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=TestProtobufRpcProto 2024-04-15 05:52:51,293 DEBUG [Reader=1,bindAddress=localhost,port=34039] ipc.SimpleRpcServer$Listener(326): Caught exception while reading: org.apache.hadoop.hbase.DoNotRetryIOException: Failing for test at org.apache.hadoop.hbase.ipc.TestBlockingIPC$TestFailingRpcServer$FailingConnection.processRequest(TestBlockingIPC.java:94) at org.apache.hadoop.hbase.ipc.ServerRpcConnection.processOneRpc(ServerRpcConnection.java:444) at org.apache.hadoop.hbase.ipc.SimpleServerRpcConnection.process(SimpleServerRpcConnection.java:286) at org.apache.hadoop.hbase.ipc.SimpleServerRpcConnection.readAndProcess(SimpleServerRpcConnection.java:252) at org.apache.hadoop.hbase.ipc.SimpleRpcServer$Listener.doRead(SimpleRpcServer.java:319) at org.apache.hadoop.hbase.ipc.SimpleRpcServer$Listener$Reader.doRunLoop(SimpleRpcServer.java:181) at org.apache.hadoop.hbase.ipc.SimpleRpcServer$Listener$Reader.run(SimpleRpcServer.java:154) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-04-15 05:52:51,293 DEBUG [BRPC Connection (86992864) to localhost:34039 from jenkins (attempt: 1)] ipc.BlockingRpcConnection(787): Closing connection after error in call null java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:392) at org.apache.hadoop.hbase.ipc.BlockingRpcConnection.readResponse(BlockingRpcConnection.java:708) at org.apache.hadoop.hbase.ipc.BlockingRpcConnection.run(BlockingRpcConnection.java:393) at java.lang.Thread.run(Thread.java:750) 2024-04-15 05:52:51,294 DEBUG [Time-limited test] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:52:51,294 INFO [Time-limited test] ipc.AbstractTestIPC(324): Caught expected exception: org.apache.hbase.thirdparty.com.google.protobuf.ServiceException: java.io.EOFException: Call to address=localhost:34039 failed on local exception: java.io.EOFException 2024-04-15 05:52:51,294 INFO [Time-limited test] ipc.SimpleRpcServer(438): Stopping server on 34039 2024-04-15 05:52:51,294 INFO [Listener,port=34039] ipc.SimpleRpcServer$Listener(258): Listener,port=34039: stopping 2024-04-15 05:52:51,295 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(158): RpcServer.responder: stopped 2024-04-15 05:52:51,295 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(62): RpcServer.responder: stopping 2024-04-15 05:52:51,304 INFO [Time-limited test] hbase.ResourceChecker(175): after: ipc.TestBlockingIPC#testConnectionCloseWithOutstandingRPCs Thread=17 (was 16) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 278), ProcessCount=184 (was 184), AvailableMemoryMB=2912 (was 2918) 2024-04-15 05:52:51,315 INFO [Time-limited test] hbase.ResourceChecker(147): before: ipc.TestBlockingIPC#testBadPreambleHeader Thread=16, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=278, ProcessCount=184, AvailableMemoryMB=2912 2024-04-15 05:52:51,317 INFO [Time-limited test] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.SimpleRpcServer hosting 2024-04-15 05:52:51,318 INFO [Time-limited test] ipc.SimpleRpcServer$Listener(134): testRpcServer: started 3 reader(s) listening on port=42073 2024-04-15 05:52:51,319 DEBUG [Time-limited test] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79ad5bd7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-15 05:52:51,320 INFO [Time-limited test] ipc.FifoRpcScheduler(61): Using FifoRpcScheduler as user call queue; handlerCount=1; maxQueueLength=10 2024-04-15 05:52:51,320 INFO [Listener,port=42073] ipc.SimpleRpcServer$Listener(214): Listener,port=42073: starting 2024-04-15 05:52:51,320 DEBUG [RpcServer.responder] ipc.SimpleRpcServerResponder(58): RpcServer.responder: starting 2024-04-15 05:52:51,321 DEBUG [Time-limited test] ipc.RpcConnection(122): Using SIMPLE authentication for service=TestProtobufRpcProto, sasl=false 2024-04-15 05:52:51,321 DEBUG [Time-limited test] ipc.BlockingRpcConnection(501): Connecting to localhost:42073 2024-04-15 05:52:51,322 WARN [Reader=1,bindAddress=localhost,port=42073] ipc.ServerRpcConnection(706): serverVersion=0, clientVersion=0, authMethod=-10, authName=unknown from 127.0.0.1:41936 2024-04-15 05:52:51,328 DEBUG [Time-limited test] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:52:51,328 INFO [Time-limited test] ipc.SimpleRpcServer(438): Stopping server on 42073 2024-04-15 05:52:51,328 INFO [Listener,port=42073] ipc.SimpleRpcServer$Listener(258): Listener,port=42073: stopping 2024-04-15 05:52:51,328 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(158): RpcServer.responder: stopped 2024-04-15 05:52:51,329 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(62): RpcServer.responder: stopping 2024-04-15 05:52:51,340 INFO [Time-limited test] hbase.ResourceChecker(175): after: ipc.TestBlockingIPC#testBadPreambleHeader Thread=17 (was 16) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 278), ProcessCount=184 (was 184), AvailableMemoryMB=2910 (was 2912) 2024-04-15 05:52:51,351 INFO [Time-limited test] hbase.ResourceChecker(147): before: ipc.TestBlockingIPC#testCompressCellBlock Thread=16, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=278, ProcessCount=184, AvailableMemoryMB=2910 2024-04-15 05:52:51,366 INFO [Time-limited test] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.SimpleRpcServer hosting hbase.test.pb.TestProtobufRpcProto 2024-04-15 05:52:51,368 INFO [Time-limited test] ipc.SimpleRpcServer$Listener(134): testRpcServer: started 3 reader(s) listening on port=40429 2024-04-15 05:52:51,371 DEBUG [Time-limited test] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@83f2076, compressor=org.apache.hadoop.io.compress.GzipCodec@4c80a942, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-15 05:52:51,371 DEBUG [RpcServer.responder] ipc.SimpleRpcServerResponder(58): RpcServer.responder: starting 2024-04-15 05:52:51,371 INFO [Listener,port=40429] ipc.SimpleRpcServer$Listener(214): Listener,port=40429: starting 2024-04-15 05:52:51,371 INFO [Time-limited test] ipc.FifoRpcScheduler(61): Using FifoRpcScheduler as user call queue; handlerCount=1; maxQueueLength=10 2024-04-15 05:52:51,372 DEBUG [Time-limited test] ipc.RpcConnection(122): Using SIMPLE authentication for service=TestProtobufRpcProto, sasl=false 2024-04-15 05:52:51,396 DEBUG [Time-limited test] ipc.BlockingRpcConnection(501): Connecting to localhost:40429 2024-04-15 05:52:51,398 INFO [Reader=1,bindAddress=localhost,port=40429] ipc.ServerRpcConnection(540): Connection from 127.0.0.1:48734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=TestProtobufRpcProto 2024-04-15 05:52:51,419 DEBUG [Time-limited test] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:52:51,420 INFO [Time-limited test] ipc.SimpleRpcServer(438): Stopping server on 40429 2024-04-15 05:52:51,420 DEBUG [BRPC Connection (86992864) to localhost:40429 from jenkins (attempt: 1)] ipc.BlockingRpcConnection(369): Interrupted while waiting for work 2024-04-15 05:52:51,420 INFO [Listener,port=40429] ipc.SimpleRpcServer$Listener(258): Listener,port=40429: stopping 2024-04-15 05:52:51,420 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(158): RpcServer.responder: stopped 2024-04-15 05:52:51,421 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(62): RpcServer.responder: stopping 2024-04-15 05:52:51,445 INFO [Time-limited test] hbase.ResourceChecker(175): after: ipc.TestBlockingIPC#testCompressCellBlock Thread=20 (was 16) Potentially hanging thread: Listener,port=40429 org.apache.hadoop.hbase.ipc.SimpleRpcServer$Listener.run(SimpleRpcServer.java:261) Potentially hanging thread: RpcServer idle connection scanner for port 40429 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Reader=2,bindAddress=localhost,port=40429 java.lang.Integer.valueOf(Integer.java:832) sun.nio.ch.EPollSelectorImpl.updateSelectedKeys(EPollSelectorImpl.java:120) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:98) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hadoop.hbase.ipc.SimpleRpcServer$Listener$Reader.doRunLoop(SimpleRpcServer.java:174) org.apache.hadoop.hbase.ipc.SimpleRpcServer$Listener$Reader.run(SimpleRpcServer.java:154) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.responder java.lang.Thread.isInterrupted(Native Method) java.lang.Thread.interrupted(Thread.java:952) org.apache.maven.surefire.booter.spi.EventChannelEncoder.write(EventChannelEncoder.java:286) org.apache.maven.surefire.booter.spi.EventChannelEncoder.setOutErr(EventChannelEncoder.java:173) org.apache.maven.surefire.booter.spi.EventChannelEncoder.testOutput(EventChannelEncoder.java:168) org.apache.maven.surefire.api.booter.ForkingRunListener.writeTestOutput(ForkingRunListener.java:99) org.apache.maven.surefire.api.booter.ForkingRunListener.writeTestOutput(ForkingRunListener.java:43) org.apache.maven.surefire.common.junit4.JUnit4RunListener.writeTestOutput(JUnit4RunListener.java:202) org.apache.maven.surefire.api.report.ConsoleOutputCapture$ForwardingPrintStream.write(ConsoleOutputCapture.java:57) sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221) sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291) sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295) sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141) java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229) org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:54) org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:317) org.apache.log4j.WriterAppender.append(WriterAppender.java:156) org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:232) org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:57) org.apache.log4j.Category.callAppenders(Category.java:206) org.apache.log4j.Category.forcedLog(Category.java:384) org.apache.log4j.Category.log(Category.java:810) org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284) org.apache.hadoop.hbase.ipc.SimpleRpcServerResponder.run(SimpleRpcServerResponder.java:62) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 278), ProcessCount=182 (was 184), AvailableMemoryMB=2890 (was 2910) 2024-04-15 05:52:51,455 INFO [Time-limited test] hbase.ResourceChecker(147): before: ipc.TestBlockingIPC#testRpcServerForNotNullRemoteAddressInCallObject Thread=16, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=278, ProcessCount=182, AvailableMemoryMB=2889 2024-04-15 05:52:51,456 INFO [Time-limited test] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.SimpleRpcServer hosting hbase.test.pb.TestProtobufRpcProto 2024-04-15 05:52:51,460 INFO [Time-limited test] ipc.SimpleRpcServer$Listener(134): testRpcServer: started 3 reader(s) listening on port=38823 2024-04-15 05:52:51,461 DEBUG [Time-limited test] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@534708a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-15 05:52:51,461 INFO [Time-limited test] ipc.FifoRpcScheduler(61): Using FifoRpcScheduler as user call queue; handlerCount=1; maxQueueLength=10 2024-04-15 05:52:51,461 INFO [Listener,port=38823] ipc.SimpleRpcServer$Listener(214): Listener,port=38823: starting 2024-04-15 05:52:51,461 DEBUG [RpcServer.responder] ipc.SimpleRpcServerResponder(58): RpcServer.responder: starting 2024-04-15 05:52:51,464 DEBUG [Time-limited test] ipc.RpcConnection(122): Using SIMPLE authentication for service=TestProtobufRpcProto, sasl=false 2024-04-15 05:52:51,465 DEBUG [Time-limited test] ipc.BlockingRpcConnection(501): Connecting to localhost:38823 2024-04-15 05:52:51,467 INFO [Reader=1,bindAddress=localhost,port=38823] ipc.ServerRpcConnection(540): Connection from 127.0.0.1:50234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=TestProtobufRpcProto 2024-04-15 05:52:51,474 DEBUG [Time-limited test] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:52:51,474 INFO [Time-limited test] ipc.SimpleRpcServer(438): Stopping server on 38823 2024-04-15 05:52:51,474 DEBUG [BRPC Connection (86992864) to localhost:38823 from jenkins (attempt: 1)] ipc.BlockingRpcConnection(369): Interrupted while waiting for work 2024-04-15 05:52:51,474 INFO [Listener,port=38823] ipc.SimpleRpcServer$Listener(258): Listener,port=38823: stopping 2024-04-15 05:52:51,475 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(158): RpcServer.responder: stopped 2024-04-15 05:52:51,475 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(62): RpcServer.responder: stopping 2024-04-15 05:52:51,485 INFO [Time-limited test] hbase.ResourceChecker(175): after: ipc.TestBlockingIPC#testRpcServerForNotNullRemoteAddressInCallObject Thread=18 (was 16) Potentially hanging thread: Reader=0,bindAddress=localhost,port=38823 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hadoop.hbase.ipc.SimpleRpcServer$Listener$Reader.doRunLoop(SimpleRpcServer.java:174) org.apache.hadoop.hbase.ipc.SimpleRpcServer$Listener$Reader.run(SimpleRpcServer.java:154) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.responder sun.misc.Unsafe.putInt(Native Method) sun.nio.ch.NativeObject.putInt(NativeObject.java:271) sun.nio.ch.EPollArrayWrapper.putEventOps(EPollArrayWrapper.java:150) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:101) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.hbase.ipc.SimpleRpcServerResponder.doRunLoop(SimpleRpcServerResponder.java:112) org.apache.hadoop.hbase.ipc.SimpleRpcServerResponder.run(SimpleRpcServerResponder.java:60) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 278), ProcessCount=180 (was 182), AvailableMemoryMB=2893 (was 2889) - AvailableMemoryMB LEAK? - 2024-04-15 05:52:51,494 INFO [Time-limited test] hbase.ResourceChecker(147): before: ipc.TestBlockingIPC#testRemoteError Thread=16, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=278, ProcessCount=180, AvailableMemoryMB=2897 2024-04-15 05:52:51,494 INFO [Time-limited test] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.SimpleRpcServer hosting hbase.test.pb.TestProtobufRpcProto 2024-04-15 05:52:51,495 INFO [Time-limited test] ipc.SimpleRpcServer$Listener(134): testRpcServer: started 3 reader(s) listening on port=39903 2024-04-15 05:52:51,495 DEBUG [Time-limited test] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ae9d16d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-15 05:52:51,496 INFO [Time-limited test] ipc.FifoRpcScheduler(61): Using FifoRpcScheduler as user call queue; handlerCount=1; maxQueueLength=10 2024-04-15 05:52:51,496 INFO [Listener,port=39903] ipc.SimpleRpcServer$Listener(214): Listener,port=39903: starting 2024-04-15 05:52:51,496 DEBUG [RpcServer.responder] ipc.SimpleRpcServerResponder(58): RpcServer.responder: starting 2024-04-15 05:52:51,499 DEBUG [Time-limited test] ipc.RpcConnection(122): Using SIMPLE authentication for service=TestProtobufRpcProto, sasl=false 2024-04-15 05:52:51,499 DEBUG [Time-limited test] ipc.BlockingRpcConnection(501): Connecting to localhost:39903 2024-04-15 05:52:51,500 INFO [Reader=1,bindAddress=localhost,port=39903] ipc.ServerRpcConnection(540): Connection from 127.0.0.1:48468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=TestProtobufRpcProto 2024-04-15 05:52:51,503 DEBUG [FifoRpcScheduler.handler-pool-0] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.DoNotRetryIOException: server error! at org.apache.hadoop.hbase.ipc.TestProtobufRpcServiceImpl.error(TestProtobufRpcServiceImpl.java:104) at org.apache.hadoop.hbase.shaded.ipc.protobuf.generated.TestRpcServiceProtos$TestProtobufRpcProto$2.callBlockingMethod(TestRpcServiceProtos.java:142) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:113) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-04-15 05:52:51,503 DEBUG [FifoRpcScheduler.handler-pool-0] ipc.CallRunner(144): callId: 0 service: TestProtobufRpcProto methodName: error size: 17 connection: 127.0.0.1:48468 deadline: 9223372036854775807, exception=org.apache.hadoop.hbase.DoNotRetryIOException: server error! 2024-04-15 05:52:51,504 DEBUG [Time-limited test] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:52:51,504 INFO [Time-limited test] ipc.AbstractTestIPC(264): Caught expected exception: org.apache.hbase.thirdparty.com.google.protobuf.ServiceException: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException): org.apache.hadoop.hbase.DoNotRetryIOException: server error! at org.apache.hadoop.hbase.ipc.TestProtobufRpcServiceImpl.error(TestProtobufRpcServiceImpl.java:104) at org.apache.hadoop.hbase.shaded.ipc.protobuf.generated.TestRpcServiceProtos$TestProtobufRpcProto$2.callBlockingMethod(TestRpcServiceProtos.java:142) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:113) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-04-15 05:52:51,504 DEBUG [BRPC Connection (86992864) to localhost:39903 from jenkins (attempt: 1)] ipc.BlockingRpcConnection(369): Interrupted while waiting for work 2024-04-15 05:52:51,505 INFO [Time-limited test] ipc.SimpleRpcServer(438): Stopping server on 39903 2024-04-15 05:52:51,505 INFO [Listener,port=39903] ipc.SimpleRpcServer$Listener(258): Listener,port=39903: stopping 2024-04-15 05:52:51,505 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(158): RpcServer.responder: stopped 2024-04-15 05:52:51,505 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(62): RpcServer.responder: stopping 2024-04-15 05:52:51,514 INFO [Time-limited test] hbase.ResourceChecker(175): after: ipc.TestBlockingIPC#testRemoteError Thread=17 (was 16) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 278), ProcessCount=180 (was 180), AvailableMemoryMB=2893 (was 2897) 2024-04-15 05:52:51,525 INFO [Time-limited test] hbase.ResourceChecker(147): before: ipc.TestBlockingIPC#testNoCodec Thread=16, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=278, ProcessCount=180, AvailableMemoryMB=2893 2024-04-15 05:52:51,538 INFO [Time-limited test] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.SimpleRpcServer hosting hbase.test.pb.TestProtobufRpcProto 2024-04-15 05:52:51,540 INFO [Time-limited test] ipc.SimpleRpcServer$Listener(134): testRpcServer: started 3 reader(s) listening on port=42423 2024-04-15 05:52:51,541 DEBUG [Time-limited test] ipc.AbstractRpcClient(189): Codec=null, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-15 05:52:51,541 DEBUG [RpcServer.responder] ipc.SimpleRpcServerResponder(58): RpcServer.responder: starting 2024-04-15 05:52:51,544 INFO [Time-limited test] ipc.FifoRpcScheduler(61): Using FifoRpcScheduler as user call queue; handlerCount=1; maxQueueLength=10 2024-04-15 05:52:51,545 INFO [Listener,port=42423] ipc.SimpleRpcServer$Listener(214): Listener,port=42423: starting 2024-04-15 05:52:51,545 DEBUG [Time-limited test] ipc.RpcConnection(122): Using SIMPLE authentication for service=TestProtobufRpcProto, sasl=false 2024-04-15 05:52:51,545 DEBUG [Time-limited test] ipc.BlockingRpcConnection(501): Connecting to localhost:42423 2024-04-15 05:52:51,546 INFO [Reader=1,bindAddress=localhost,port=42423] ipc.ServerRpcConnection(540): Connection from 127.0.0.1:33210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=TestProtobufRpcProto 2024-04-15 05:52:51,550 DEBUG [Time-limited test] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:52:51,551 INFO [Time-limited test] ipc.SimpleRpcServer(438): Stopping server on 42423 2024-04-15 05:52:51,551 DEBUG [BRPC Connection (86992864) to localhost:42423 from jenkins (attempt: 1)] ipc.BlockingRpcConnection(369): Interrupted while waiting for work 2024-04-15 05:52:51,551 INFO [Listener,port=42423] ipc.SimpleRpcServer$Listener(258): Listener,port=42423: stopping 2024-04-15 05:52:51,551 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(158): RpcServer.responder: stopped 2024-04-15 05:52:51,552 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(62): RpcServer.responder: stopping 2024-04-15 05:52:51,562 INFO [Time-limited test] hbase.ResourceChecker(175): after: ipc.TestBlockingIPC#testNoCodec Thread=18 (was 16) Potentially hanging thread: RpcServer.responder java.lang.Thread.isInterrupted(Native Method) java.lang.Thread.interrupted(Thread.java:952) org.apache.maven.surefire.booter.spi.EventChannelEncoder.write(EventChannelEncoder.java:286) org.apache.maven.surefire.booter.spi.EventChannelEncoder.setOutErr(EventChannelEncoder.java:173) org.apache.maven.surefire.booter.spi.EventChannelEncoder.testOutput(EventChannelEncoder.java:168) org.apache.maven.surefire.api.booter.ForkingRunListener.writeTestOutput(ForkingRunListener.java:99) org.apache.maven.surefire.api.booter.ForkingRunListener.writeTestOutput(ForkingRunListener.java:43) org.apache.maven.surefire.common.junit4.JUnit4RunListener.writeTestOutput(JUnit4RunListener.java:202) org.apache.maven.surefire.api.report.ConsoleOutputCapture$ForwardingPrintStream.write(ConsoleOutputCapture.java:57) sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221) sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291) sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295) sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141) java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229) org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:54) org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:317) org.apache.log4j.WriterAppender.append(WriterAppender.java:156) org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:232) org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:57) org.apache.log4j.Category.callAppenders(Category.java:206) org.apache.log4j.Category.forcedLog(Category.java:384) org.apache.log4j.Category.log(Category.java:810) org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284) org.apache.hadoop.hbase.ipc.SimpleRpcServerResponder.run(SimpleRpcServerResponder.java:62) Potentially hanging thread: BRPC Connection (86992864) to localhost:42423 from jenkins (attempt: 1) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 278), ProcessCount=182 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=2885 (was 2893) 2024-04-15 05:52:51,576 INFO [Time-limited test] hbase.ResourceChecker(147): before: ipc.TestBlockingIPC#testRpcMaxRequestSize Thread=16, OpenFileDescriptor=296, MaxFileDescriptor=60000, SystemLoadAverage=278, ProcessCount=182, AvailableMemoryMB=2870 2024-04-15 05:52:51,577 INFO [Time-limited test] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.SimpleRpcServer hosting hbase.test.pb.TestProtobufRpcProto 2024-04-15 05:52:51,578 INFO [Time-limited test] ipc.SimpleRpcServer$Listener(134): testRpcServer: started 3 reader(s) listening on port=44899 2024-04-15 05:52:51,581 DEBUG [Time-limited test] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a6ccb0d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-15 05:52:51,581 DEBUG [RpcServer.responder] ipc.SimpleRpcServerResponder(58): RpcServer.responder: starting 2024-04-15 05:52:51,582 INFO [Listener,port=44899] ipc.SimpleRpcServer$Listener(214): Listener,port=44899: starting 2024-04-15 05:52:51,582 INFO [Time-limited test] ipc.FifoRpcScheduler(61): Using FifoRpcScheduler as user call queue; handlerCount=1; maxQueueLength=10 2024-04-15 05:52:51,594 DEBUG [Time-limited test] ipc.RpcConnection(122): Using SIMPLE authentication for service=TestProtobufRpcProto, sasl=false 2024-04-15 05:52:51,595 DEBUG [Time-limited test] ipc.BlockingRpcConnection(501): Connecting to localhost:44899 2024-04-15 05:52:51,596 INFO [Reader=1,bindAddress=localhost,port=44899] ipc.ServerRpcConnection(540): Connection from 127.0.0.1:37058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=TestProtobufRpcProto 2024-04-15 05:52:51,597 WARN [Reader=1,bindAddress=localhost,port=44899] ipc.SimpleServerRpcConnection(187): RPC data length of 1260 received from 127.0.0.1 is greater than max allowed 1000. Set "hbase.ipc.max.request.size" on server to override this limit (not recommended) 2024-04-15 05:52:51,603 DEBUG [Time-limited test] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:52:51,603 INFO [Time-limited test] ipc.AbstractTestIPC(225): Caught expected exception: org.apache.hbase.thirdparty.com.google.protobuf.ServiceException: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.exceptions.RequestTooBigException): RPC data length of 1260 received from 127.0.0.1 is greater than max allowed 1000. Set "hbase.ipc.max.request.size" on server to override this limit (not recommended) 2024-04-15 05:52:51,603 DEBUG [BRPC Connection (86992864) to localhost:44899 from jenkins (attempt: 1)] ipc.BlockingRpcConnection(369): Interrupted while waiting for work 2024-04-15 05:52:51,603 INFO [Time-limited test] ipc.SimpleRpcServer(438): Stopping server on 44899 2024-04-15 05:52:51,604 INFO [Listener,port=44899] ipc.SimpleRpcServer$Listener(258): Listener,port=44899: stopping 2024-04-15 05:52:51,604 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(158): RpcServer.responder: stopped 2024-04-15 05:52:51,604 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(62): RpcServer.responder: stopping 2024-04-15 05:52:51,615 INFO [Time-limited test] hbase.ResourceChecker(175): after: ipc.TestBlockingIPC#testRpcMaxRequestSize Thread=16 (was 16), OpenFileDescriptor=294 (was 296), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 278), ProcessCount=182 (was 182), AvailableMemoryMB=2868 (was 2870) 2024-04-15 05:52:51,625 INFO [Time-limited test] hbase.ResourceChecker(147): before: ipc.TestBlockingIPC#testAsyncTimeout Thread=16, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=278, ProcessCount=182, AvailableMemoryMB=2868 2024-04-15 05:52:51,625 INFO [Time-limited test] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.SimpleRpcServer hosting hbase.test.pb.TestProtobufRpcProto 2024-04-15 05:52:51,626 INFO [Time-limited test] ipc.SimpleRpcServer$Listener(134): testRpcServer: started 3 reader(s) listening on port=44769 2024-04-15 05:52:51,626 DEBUG [Time-limited test] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ce5bcc5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-15 05:52:51,626 INFO [Time-limited test] ipc.FifoRpcScheduler(61): Using FifoRpcScheduler as user call queue; handlerCount=1; maxQueueLength=10 2024-04-15 05:52:51,626 INFO [Listener,port=44769] ipc.SimpleRpcServer$Listener(214): Listener,port=44769: starting 2024-04-15 05:52:51,626 DEBUG [RpcServer.responder] ipc.SimpleRpcServerResponder(58): RpcServer.responder: starting 2024-04-15 05:52:51,627 DEBUG [Time-limited test] ipc.RpcConnection(122): Using SIMPLE authentication for service=TestProtobufRpcProto, sasl=false 2024-04-15 05:52:51,627 DEBUG [Time-limited test] ipc.BlockingRpcConnection(501): Connecting to localhost:44769 2024-04-15 05:52:51,629 INFO [Reader=1,bindAddress=localhost,port=44769] ipc.ServerRpcConnection(540): Connection from 127.0.0.1:37042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=TestProtobufRpcProto 2024-04-15 05:52:51,736 INFO [Time-limited test] ipc.AbstractTestIPC(411): Caught expected exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:44769 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=0,methodName=pause], waitTime=108ms, rpcTimeout=100ms 2024-04-15 05:52:51,736 INFO [Time-limited test] ipc.AbstractTestIPC(411): Caught expected exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:44769 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=1,methodName=pause], waitTime=106ms, rpcTimeout=100ms 2024-04-15 05:52:51,736 INFO [Time-limited test] ipc.AbstractTestIPC(411): Caught expected exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:44769 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=2,methodName=pause], waitTime=106ms, rpcTimeout=100ms 2024-04-15 05:52:51,737 INFO [Time-limited test] ipc.AbstractTestIPC(411): Caught expected exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:44769 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=3,methodName=pause], waitTime=107ms, rpcTimeout=100ms 2024-04-15 05:52:51,737 INFO [Time-limited test] ipc.AbstractTestIPC(411): Caught expected exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:44769 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=4,methodName=pause], waitTime=107ms, rpcTimeout=100ms 2024-04-15 05:52:51,737 INFO [Time-limited test] ipc.AbstractTestIPC(411): Caught expected exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:44769 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=5,methodName=pause], waitTime=107ms, rpcTimeout=100ms 2024-04-15 05:52:51,737 INFO [Time-limited test] ipc.AbstractTestIPC(411): Caught expected exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:44769 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=6,methodName=pause], waitTime=106ms, rpcTimeout=100ms 2024-04-15 05:52:51,737 INFO [Time-limited test] ipc.AbstractTestIPC(411): Caught expected exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:44769 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=7,methodName=pause], waitTime=106ms, rpcTimeout=100ms 2024-04-15 05:52:51,738 INFO [Time-limited test] ipc.AbstractTestIPC(411): Caught expected exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:44769 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=8,methodName=pause], waitTime=106ms, rpcTimeout=100ms 2024-04-15 05:52:51,738 INFO [Time-limited test] ipc.AbstractTestIPC(411): Caught expected exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call to address=localhost:44769 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call[id=9,methodName=pause], waitTime=106ms, rpcTimeout=100ms 2024-04-15 05:52:51,738 DEBUG [Time-limited test] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:52:51,738 INFO [Time-limited test] ipc.SimpleRpcServer(438): Stopping server on 44769 2024-04-15 05:52:51,738 INFO [Listener,port=44769] ipc.SimpleRpcServer$Listener(258): Listener,port=44769: stopping 2024-04-15 05:52:51,739 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(158): RpcServer.responder: stopped 2024-04-15 05:52:51,739 INFO [RpcServer.responder] ipc.SimpleRpcServerResponder(62): RpcServer.responder: stopping 2024-04-15 05:52:51,752 INFO [Time-limited test] hbase.ResourceChecker(175): after: ipc.TestBlockingIPC#testAsyncTimeout Thread=18 (was 16) Potentially hanging thread: RpcServer.responder sun.nio.ch.FileDispatcherImpl.closeIntFD(Native Method) sun.nio.ch.EPollSelectorImpl.implClose(EPollSelectorImpl.java:150) sun.nio.ch.SelectorImpl.implCloseSelector(SelectorImpl.java:113) java.nio.channels.spi.AbstractSelector.close(AbstractSelector.java:111) org.apache.hadoop.hbase.ipc.SimpleRpcServerResponder.run(SimpleRpcServerResponder.java:64) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 278), ProcessCount=182 (was 182), AvailableMemoryMB=2868 (was 2868)