Testsuite: org.apache.catalina.tribes.group.interceptors.TestTcpFailureDetector Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.969 sec ------------- Standard Output --------------- testTcpMcastFail() Channel-2:member added[Channel-1] Channel-1:member added[Channel-2] Channel-2:member disappeared[Channel-1] testTcpFailureMemberAdd() Channel-2:member added[Channel-1] testTcpSendFailureMemberDrop() Channel-2:member added[Channel-1] Channel-1:member added[Channel-2] Channel-1:member disappeared[Channel-2] Channel-2:member disappeared[Channel-1] ------------- ---------------- --------------- ------------- Standard Error ----------------- Oct 12, 2023 2:21:38 AM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4000] Oct 12, 2023 2:21:38 AM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Oct 12, 2023 2:21:38 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Oct 12, 2023 2:21:38 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4004,{127, 0, 0, 1},4004, alive=1510, securePort=-1, UDP Port=-1, id={-96 -38 1 86 75 -103 78 -43 -108 73 -81 -96 -5 -88 34 -42 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:38 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4011,{127, 0, 0, 1},4011, alive=4524, securePort=-1, UDP Port=-1, id={-74 -31 99 40 -123 55 76 -108 -85 117 102 66 -21 1 -86 3 }, payload={}, command={}, domain={127 -8 -93 33 -23 36 74 -62 -98 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:38 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4012,{127, 0, 0, 1},4012, alive=4531, securePort=-1, UDP Port=-1, id={-24 45 -110 96 -74 -91 71 -51 -124 19 -38 -118 124 -22 47 100 }, payload={}, command={}, domain={127 -8 -93 33 -23 36 74 -62 -98 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:38 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=1551, securePort=-1, UDP Port=-1, id={1 39 41 -55 -31 -116 66 94 -88 65 -45 99 90 11 116 33 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:38 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4009,{127, 0, 0, 1},4009, alive=1552, securePort=-1, UDP Port=-1, id={-74 115 9 108 46 13 79 124 -102 -90 -35 41 93 -41 -43 42 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:38 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4006,{127, 0, 0, 1},4006, alive=1569, securePort=-1, UDP Port=-1, id={50 116 5 -91 90 81 65 -90 -128 -19 -1 60 -75 73 76 56 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:38 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4007,{127, 0, 0, 1},4007, alive=1579, securePort=-1, UDP Port=-1, id={-7 -78 -2 43 79 -83 64 -70 -67 -127 123 -24 -56 21 -54 -74 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:38 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4010,{127, 0, 0, 1},4010, alive=1571, securePort=-1, UDP Port=-1, id={-68 -6 -25 -72 101 -38 65 -87 -97 63 1 113 85 23 -3 -20 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:38 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4003,{127, 0, 0, 1},4003, alive=1604, securePort=-1, UDP Port=-1, id={-118 -112 -69 -77 -23 2 64 -36 -104 20 3 -116 -42 121 21 -23 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:38 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4008,{127, 0, 0, 1},4008, alive=1596, securePort=-1, UDP Port=-1, id={-14 117 87 -82 74 -86 69 35 -103 -17 107 35 1 -80 -48 -1 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:38 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4002,{127, 0, 0, 1},4002, alive=1676, securePort=-1, UDP Port=-1, id={-122 -40 -64 -63 -31 -90 77 -116 -111 -9 29 -64 -1 45 -49 -68 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:38 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4005,{127, 0, 0, 1},4005, alive=1680, securePort=-1, UDP Port=-1, id={-85 -65 -4 78 51 -66 65 -74 -97 -117 -7 -52 102 -17 -107 44 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:39 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Oct 12, 2023 2:21:39 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Oct 12, 2023 2:21:40 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Oct 12, 2023 2:21:40 AM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4001] Oct 12, 2023 2:21:40 AM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Oct 12, 2023 2:21:40 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Oct 12, 2023 2:21:40 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4004,{127, 0, 0, 1},4004, alive=3511, securePort=-1, UDP Port=-1, id={-96 -38 1 86 75 -103 78 -43 -108 73 -81 -96 -5 -88 34 -42 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:40 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4009,{127, 0, 0, 1},4009, alive=3553, securePort=-1, UDP Port=-1, id={-74 115 9 108 46 13 79 124 -102 -90 -35 41 93 -41 -43 42 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:40 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4006,{127, 0, 0, 1},4006, alive=3570, securePort=-1, UDP Port=-1, id={50 116 5 -91 90 81 65 -90 -128 -19 -1 60 -75 73 76 56 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:40 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4007,{127, 0, 0, 1},4007, alive=3580, securePort=-1, UDP Port=-1, id={-7 -78 -2 43 79 -83 64 -70 -67 -127 123 -24 -56 21 -54 -74 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:40 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4010,{127, 0, 0, 1},4010, alive=3572, securePort=-1, UDP Port=-1, id={-68 -6 -25 -72 101 -38 65 -87 -97 63 1 113 85 23 -3 -20 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:40 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4003,{127, 0, 0, 1},4003, alive=3605, securePort=-1, UDP Port=-1, id={-118 -112 -69 -77 -23 2 64 -36 -104 20 3 -116 -42 121 21 -23 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:40 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4008,{127, 0, 0, 1},4008, alive=3597, securePort=-1, UDP Port=-1, id={-14 117 87 -82 74 -86 69 35 -103 -17 107 35 1 -80 -48 -1 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:40 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4002,{127, 0, 0, 1},4002, alive=3678, securePort=-1, UDP Port=-1, id={-122 -40 -64 -63 -31 -90 77 -116 -111 -9 29 -64 -1 45 -49 -68 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:40 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4005,{127, 0, 0, 1},4005, alive=3681, securePort=-1, UDP Port=-1, id={-85 -65 -4 78 51 -66 65 -74 -97 -117 -7 -52 102 -17 -107 44 }, payload={}, command={}, domain={-119 63 -124 -29 -95 22 67 5 -125 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:40 AM org.apache.catalina.tribes.io.BufferPool getBufferPool INFO: Created a buffer pool with max size:[104857600] bytes of type: [org.apache.catalina.tribes.io.BufferPool15Impl] Oct 12, 2023 2:21:41 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Oct 12, 2023 2:21:41 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Oct 12, 2023 2:21:41 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4011,{127, 0, 0, 1},4011, alive=1002, securePort=-1, UDP Port=-1, id={-5 121 -6 -29 -5 -100 72 41 -68 -110 45 89 89 -31 123 15 }, payload={}, command={}, domain={-2 -9 22 -113 6 -80 64 89 -126 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:41 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4011,{127, 0, 0, 1},4011, alive=1003, securePort=-1, UDP Port=-1, id={-5 121 -6 -29 -5 -100 72 41 -68 -110 45 89 89 -31 123 15 }, payload={}, command={}, domain={-2 -9 22 -113 6 -80 64 89 -126 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:41 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4012,{127, 0, 0, 1},4012, alive=1001, securePort=-1, UDP Port=-1, id={116 -51 2 -56 39 50 72 -123 -113 -51 -93 35 99 10 46 -7 }, payload={}, command={}, domain={-2 -9 22 -113 6 -80 64 89 -126 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:41 AM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4012,{127, 0, 0, 1},4012, alive=1001, securePort=-1, UDP Port=-1, id={116 -51 2 -56 39 50 72 -123 -113 -51 -93 35 99 10 46 -7 }, payload={}, command={}, domain={-2 -9 22 -113 6 -80 64 89 -126 ...(16)}]] was refused to join cluster Oct 12, 2023 2:21:42 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Oct 12, 2023 2:21:45 AM org.apache.catalina.tribes.group.interceptors.TcpFailureDetector memberDisappeared INFO: Received memberDisappeared[org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=2006, securePort=-1, UDP Port=-1, id={124 -28 -34 112 68 -19 68 -45 -104 63 64 36 -46 102 -2 119 }, payload={67 104 97 110 110 101 108 45 50 ...(9)}, command={}, domain={24 64 50 41 97 33 65 -12 -85 ...(16)}]] message. Will verify. Oct 12, 2023 2:21:45 AM org.apache.catalina.tribes.group.interceptors.TcpFailureDetector memberDisappeared INFO: Verification complete. Member still alive[org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=2006, securePort=-1, UDP Port=-1, id={124 -28 -34 112 68 -19 68 -45 -104 63 64 36 -46 102 -2 119 }, payload={67 104 97 110 110 101 108 45 50 ...(9)}, command={}, domain={24 64 50 41 97 33 65 -12 -85 ...(16)}]] Oct 12, 2023 2:21:47 AM org.apache.catalina.tribes.transport.nio.NioReplicationTask run WARNING: IOException in replication worker, unable to drain channel. Probable cause: Keep alive socket closed[null]. Oct 12, 2023 2:21:47 AM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4000] Oct 12, 2023 2:21:47 AM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Oct 12, 2023 2:21:47 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Oct 12, 2023 2:21:48 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Oct 12, 2023 2:21:48 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Oct 12, 2023 2:21:49 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Oct 12, 2023 2:21:49 AM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4001] Oct 12, 2023 2:21:49 AM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Oct 12, 2023 2:21:49 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Oct 12, 2023 2:21:50 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Oct 12, 2023 2:21:50 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Oct 12, 2023 2:21:51 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Oct 12, 2023 2:21:51 AM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4000] Oct 12, 2023 2:21:51 AM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Oct 12, 2023 2:21:51 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Oct 12, 2023 2:21:52 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Oct 12, 2023 2:21:52 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Oct 12, 2023 2:21:53 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Oct 12, 2023 2:21:53 AM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4001] Oct 12, 2023 2:21:53 AM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Oct 12, 2023 2:21:53 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Oct 12, 2023 2:21:54 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Oct 12, 2023 2:21:54 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Oct 12, 2023 2:21:55 AM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Oct 12, 2023 2:21:55 AM org.apache.catalina.tribes.transport.nio.ParallelNioSender doLoop WARNING: Member send is failing for:[tcp://{127, 0, 0, 1}:4001] ; Setting to suspect and retrying. Oct 12, 2023 2:21:55 AM org.apache.catalina.tribes.group.interceptors.TcpFailureDetector memberDisappeared INFO: Received memberDisappeared[org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=2010, securePort=-1, UDP Port=-1, id={-107 -60 18 -77 68 -110 78 -109 -115 83 47 40 -15 25 56 -77 }, payload={67 104 97 110 110 101 108 45 50 ...(9)}, command={}, domain={-69 -74 98 78 -112 61 70 -121 -98 ...(16)}]] message. Will verify. Oct 12, 2023 2:21:55 AM org.apache.catalina.tribes.group.interceptors.TcpFailureDetector memberDisappeared INFO: Verification complete. Member disappeared[org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=2010, securePort=-1, UDP Port=-1, id={-107 -60 18 -77 68 -110 78 -109 -115 83 47 40 -15 25 56 -77 }, payload={67 104 97 110 110 101 108 45 50 ...(9)}, command={}, domain={-69 -74 98 78 -112 61 70 -121 -98 ...(16)}]] ------------- ---------------- --------------- Testcase: testTcpMcastFail took 9.542 sec Testcase: testTcpFailureMemberAdd took 4.253 sec Testcase: testTcpSendFailureMemberDrop took 4.162 sec