Testsuite: org.apache.catalina.tribes.group.interceptors.TestTcpFailureDetector Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.748 sec ------------- Standard Output --------------- testTcpMcastFail() Channel-2:member added[Channel-1] Channel-1:member added[Channel-2] testTcpFailureMemberAdd() Channel-2:member added[Channel-1] testTcpSendFailureMemberDrop() Channel-2:member added[Channel-1] Channel-1:member added[Channel-2] Channel-1:member disappeared[Channel-2] ------------- ---------------- --------------- ------------- Standard Error ----------------- Jun 02, 2023 12:41:25 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Jun 02, 2023 12:41:25 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4000] Jun 02, 2023 12:41:25 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Jun 02, 2023 12:41:25 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Jun 02, 2023 12:41:26 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4011,{127, 0, 0, 1},4011, alive=5034, securePort=-1, UDP Port=-1, id={-44 66 -18 49 -128 -1 74 -95 -97 49 -9 98 27 -97 76 100 }, payload={}, command={}, domain={-114 -2 -92 -86 54 -14 66 89 -99 ...(16)}]] was refused to join cluster Jun 02, 2023 12:41:26 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4012,{127, 0, 0, 1},4012, alive=5036, securePort=-1, UDP Port=-1, id={23 -126 -102 -56 74 -4 68 61 -117 95 -44 -106 -124 -32 113 11 }, payload={}, command={}, domain={-114 -2 -92 -86 54 -14 66 89 -99 ...(16)}]] was refused to join cluster Jun 02, 2023 12:41:26 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4002,{127, 0, 0, 1},4002, alive=2519, securePort=-1, UDP Port=-1, id={7 -76 -1 12 48 95 79 -119 -65 115 -2 -32 -3 -86 98 125 }, payload={}, command={}, domain={16 -8 63 -17 96 52 70 65 -96 ...(16)}]] was refused to join cluster Jun 02, 2023 12:41:26 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4005,{127, 0, 0, 1},4005, alive=2548, securePort=-1, UDP Port=-1, id={-86 63 -44 90 87 40 75 60 -79 61 -82 10 7 -75 -47 -85 }, payload={}, command={}, domain={16 -8 63 -17 96 52 70 65 -96 ...(16)}]] was refused to join cluster Jun 02, 2023 12:41:26 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4008,{127, 0, 0, 1},4008, alive=2553, securePort=-1, UDP Port=-1, id={-34 -37 -59 -86 53 -44 77 -55 -69 -98 -38 -84 30 81 2 -123 }, payload={}, command={}, domain={16 -8 63 -17 96 52 70 65 -96 ...(16)}]] was refused to join cluster Jun 02, 2023 12:41:26 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4010,{127, 0, 0, 1},4010, alive=2555, securePort=-1, UDP Port=-1, id={-46 119 71 -64 -103 -107 69 -58 -91 -115 -9 -37 48 6 40 -68 }, payload={}, command={}, domain={16 -8 63 -17 96 52 70 65 -96 ...(16)}]] was refused to join cluster Jun 02, 2023 12:41:26 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4004,{127, 0, 0, 1},4004, alive=2567, securePort=-1, UDP Port=-1, id={-110 -58 77 -57 41 12 68 -68 -116 -104 85 33 112 101 -27 -57 }, payload={}, command={}, domain={16 -8 63 -17 96 52 70 65 -96 ...(16)}]] was refused to join cluster Jun 02, 2023 12:41:26 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4009,{127, 0, 0, 1},4009, alive=2559, securePort=-1, UDP Port=-1, id={-31 -105 106 -71 -83 -76 79 4 -94 83 14 -13 48 -27 -54 -17 }, payload={}, command={}, domain={16 -8 63 -17 96 52 70 65 -96 ...(16)}]] was refused to join cluster Jun 02, 2023 12:41:26 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4007,{127, 0, 0, 1},4007, alive=2574, securePort=-1, UDP Port=-1, id={55 115 25 30 -21 52 72 -24 -123 -30 -78 -65 -72 123 109 7 }, payload={}, command={}, domain={16 -8 63 -17 96 52 70 65 -96 ...(16)}]] was refused to join cluster Jun 02, 2023 12:41:26 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4003,{127, 0, 0, 1},4003, alive=2580, securePort=-1, UDP Port=-1, id={-57 108 -7 -3 80 -81 73 -95 -74 93 57 -66 23 7 114 -73 }, payload={}, command={}, domain={16 -8 63 -17 96 52 70 65 -96 ...(16)}]] was refused to join cluster Jun 02, 2023 12:41:26 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4006,{127, 0, 0, 1},4006, alive=2573, securePort=-1, UDP Port=-1, id={56 109 22 5 -126 41 70 -17 -95 -56 13 98 67 -26 -56 -102 }, payload={}, command={}, domain={16 -8 63 -17 96 52 70 65 -96 ...(16)}]] was refused to join cluster Jun 02, 2023 12:41:26 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Jun 02, 2023 12:41:26 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Jun 02, 2023 12:41:27 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Jun 02, 2023 12:41:27 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Jun 02, 2023 12:41:27 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4003] Jun 02, 2023 12:41:27 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Jun 02, 2023 12:41:27 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Jun 02, 2023 12:41:28 PM org.apache.catalina.tribes.io.BufferPool getBufferPool INFO: Created a buffer pool with max size:[104857600] bytes of type: [org.apache.catalina.tribes.io.BufferPool] Jun 02, 2023 12:41:28 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=1002, securePort=-1, UDP Port=-1, id={63 72 69 -56 -23 51 79 -128 -98 -110 20 5 0 -85 -13 38 }, payload={}, command={}, domain={125 37 52 111 61 -32 76 31 -69 ...(16)}]] was refused to join cluster Jun 02, 2023 12:41:28 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4002,{127, 0, 0, 1},4002, alive=1002, securePort=-1, UDP Port=-1, id={120 -27 -105 -10 90 -28 68 60 -115 -68 12 78 -25 -7 -122 54 }, payload={}, command={}, domain={125 37 52 111 61 -32 76 31 -69 ...(16)}]] was refused to join cluster Jun 02, 2023 12:41:28 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=1002, securePort=-1, UDP Port=-1, id={63 72 69 -56 -23 51 79 -128 -98 -110 20 5 0 -85 -13 38 }, payload={}, command={}, domain={125 37 52 111 61 -32 76 31 -69 ...(16)}]] was refused to join cluster Jun 02, 2023 12:41:28 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4002,{127, 0, 0, 1},4002, alive=1002, securePort=-1, UDP Port=-1, id={120 -27 -105 -10 90 -28 68 60 -115 -68 12 78 -25 -7 -122 54 }, payload={}, command={}, domain={125 37 52 111 61 -32 76 31 -69 ...(16)}]] was refused to join cluster Jun 02, 2023 12:41:28 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Jun 02, 2023 12:41:28 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Jun 02, 2023 12:41:29 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Jun 02, 2023 12:41:32 PM org.apache.catalina.tribes.group.interceptors.TcpFailureDetector memberDisappeared INFO: Received memberDisappeared[org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4003,{127, 0, 0, 1},4003, alive=1504, securePort=-1, UDP Port=-1, id={-26 46 0 -2 -111 23 77 15 -66 -115 12 -46 -95 -119 114 45 }, payload={67 104 97 110 110 101 108 45 50 ...(9)}, command={}, domain={96 -28 41 -98 -112 15 78 65 -91 ...(16)}]] message. Will verify. Jun 02, 2023 12:41:32 PM org.apache.catalina.tribes.group.interceptors.TcpFailureDetector memberDisappeared INFO: Verification complete. Member still alive[org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4003,{127, 0, 0, 1},4003, alive=1504, securePort=-1, UDP Port=-1, id={-26 46 0 -2 -111 23 77 15 -66 -115 12 -46 -95 -119 114 45 }, payload={67 104 97 110 110 101 108 45 50 ...(9)}, command={}, domain={96 -28 41 -98 -112 15 78 65 -91 ...(16)}]] Jun 02, 2023 12:41:34 PM org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread run WARNING: Error receiving mcast package. Sleeping 500ms java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@ce13cfd[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@1b400254[Wrapped task = org.apache.catalina.tribes.membership.McastServiceImpl$$Lambda$77/0x00000008010c4b18@5e428f58]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@6f56f49f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 5] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) at org.apache.catalina.tribes.membership.McastServiceImpl.memberDataReceived(McastServiceImpl.java:433) at org.apache.catalina.tribes.membership.McastServiceImpl.receive(McastServiceImpl.java:381) at org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread.run(McastServiceImpl.java:581) Jun 02, 2023 12:41:34 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Jun 02, 2023 12:41:34 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4000] Jun 02, 2023 12:41:34 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Jun 02, 2023 12:41:34 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Jun 02, 2023 12:41:35 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Jun 02, 2023 12:41:35 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Jun 02, 2023 12:41:36 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Jun 02, 2023 12:41:36 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Jun 02, 2023 12:41:36 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4001] Jun 02, 2023 12:41:36 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Jun 02, 2023 12:41:36 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Jun 02, 2023 12:41:37 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Jun 02, 2023 12:41:38 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Jun 02, 2023 12:41:38 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Jun 02, 2023 12:41:39 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Jun 02, 2023 12:41:39 PM org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread run WARNING: Error receiving mcast package. Sleeping 500ms java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@5b55399a[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@51ad52ea[Wrapped task = org.apache.catalina.tribes.membership.McastServiceImpl$$Lambda$77/0x00000008010c4b18@5f6ab6af]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@1e57bc94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 4] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) at org.apache.catalina.tribes.membership.McastServiceImpl.memberDataReceived(McastServiceImpl.java:433) at org.apache.catalina.tribes.membership.McastServiceImpl.receive(McastServiceImpl.java:381) at org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread.run(McastServiceImpl.java:581) Jun 02, 2023 12:41:39 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Jun 02, 2023 12:41:39 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4000] Jun 02, 2023 12:41:39 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Jun 02, 2023 12:41:39 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Jun 02, 2023 12:41:40 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Jun 02, 2023 12:41:40 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Jun 02, 2023 12:41:41 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Jun 02, 2023 12:41:41 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Jun 02, 2023 12:41:41 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4001] Jun 02, 2023 12:41:41 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Jun 02, 2023 12:41:41 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Jun 02, 2023 12:41:42 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Jun 02, 2023 12:41:42 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Jun 02, 2023 12:41:43 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Jun 02, 2023 12:41:43 PM org.apache.catalina.tribes.transport.nio.ParallelNioSender doLoop WARNING: Member send is failing for:[tcp://{127, 0, 0, 1}:4001] ; Setting to suspect and retrying. Jun 02, 2023 12:41:43 PM org.apache.catalina.tribes.group.interceptors.TcpFailureDetector memberDisappeared INFO: Received memberDisappeared[org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=2004, securePort=-1, UDP Port=-1, id={105 -71 -9 -67 -25 -92 65 61 -94 -81 -57 -66 16 -63 125 -4 }, payload={67 104 97 110 110 101 108 45 50 ...(9)}, command={}, domain={-123 -22 73 -48 -110 -33 79 -74 -109 ...(16)}]] message. Will verify. Jun 02, 2023 12:41:43 PM org.apache.catalina.tribes.group.interceptors.TcpFailureDetector memberDisappeared INFO: Verification complete. Member disappeared[org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=2004, securePort=-1, UDP Port=-1, id={105 -71 -9 -67 -25 -92 65 61 -94 -81 -57 -66 16 -63 125 -4 }, payload={67 104 97 110 110 101 108 45 50 ...(9)}, command={}, domain={-123 -22 73 -48 -110 -33 79 -74 -109 ...(16)}]] Jun 02, 2023 12:41:43 PM org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread run WARNING: Error receiving mcast package. Sleeping 500ms java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@66ff8eda[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@27c284e1[Wrapped task = org.apache.catalina.tribes.membership.McastServiceImpl$$Lambda$77/0x00000008010c4b18@23fd14c1]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@64059d43[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 2] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) at org.apache.catalina.tribes.membership.McastServiceImpl.memberDataReceived(McastServiceImpl.java:433) at org.apache.catalina.tribes.membership.McastServiceImpl.receive(McastServiceImpl.java:381) at org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread.run(McastServiceImpl.java:581) ------------- ---------------- --------------- Testcase: testTcpMcastFail took 9.246 sec Testcase: testTcpFailureMemberAdd took 4.272 sec Testcase: testTcpSendFailureMemberDrop took 4.217 sec