Testsuite: org.apache.catalina.tribes.group.interceptors.TestTcpFailureDetector Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.899 sec ------------- Standard Output --------------- testTcpMcastFail() Channel-2:member added[Channel-1] Channel-1:member added[Channel-2] testTcpFailureMemberAdd() Channel-2:member added[Channel-1] testTcpSendFailureMemberDrop() Channel-2:member added[Channel-1] Channel-1:member added[Channel-2] Channel-1:member disappeared[Channel-2] ------------- ---------------- --------------- ------------- Standard Error ----------------- Nov 06, 2023 10:05:02 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Nov 06, 2023 10:05:02 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4012] Nov 06, 2023 10:05:02 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Nov 06, 2023 10:05:02 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Nov 06, 2023 10:05:02 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4002,{127, 0, 0, 1},4002, alive=1003, securePort=-1, UDP Port=-1, id={-52 -110 -75 -61 1 -43 68 62 -118 34 -93 59 35 -78 71 -32 }, payload={}, command={}, domain={-12 -74 -56 -66 -89 -124 65 -102 -77 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:02 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=1046, securePort=-1, UDP Port=-1, id={-2 -32 -52 -85 16 -115 71 123 -72 82 -96 -45 52 62 20 12 }, payload={}, command={}, domain={-12 -74 -56 -66 -89 -124 65 -102 -77 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:02 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4000,{127, 0, 0, 1},4000, alive=1022, securePort=-1, UDP Port=-1, id={-57 55 -88 30 108 5 73 102 -116 115 -68 84 -81 23 39 -93 }, payload={}, command={}, domain={-12 -74 -56 -66 -89 -124 65 -102 -77 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:02 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4004,{127, 0, 0, 1},4004, alive=1063, securePort=-1, UDP Port=-1, id={53 -14 8 -74 -31 -58 77 -97 -105 -66 -69 -26 -49 120 73 -103 }, payload={}, command={}, domain={-12 -74 -56 -66 -89 -124 65 -102 -77 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:02 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4006,{127, 0, 0, 1},4006, alive=1039, securePort=-1, UDP Port=-1, id={-78 -47 -118 -123 -117 -40 77 -80 -97 119 25 -3 -43 115 -45 -105 }, payload={}, command={}, domain={-12 -74 -56 -66 -89 -124 65 -102 -77 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:02 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4005,{127, 0, 0, 1},4005, alive=1061, securePort=-1, UDP Port=-1, id={0 -110 77 -43 -111 -32 73 -92 -69 2 -125 38 67 -58 -124 -82 }, payload={}, command={}, domain={-12 -74 -56 -66 -89 -124 65 -102 -77 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:02 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4003,{127, 0, 0, 1},4003, alive=1006, securePort=-1, UDP Port=-1, id={-103 64 4 -33 19 -76 78 61 -82 92 -117 -77 -76 39 -105 37 }, payload={}, command={}, domain={-12 -74 -56 -66 -89 -124 65 -102 -77 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:02 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4007,{127, 0, 0, 1},4007, alive=1004, securePort=-1, UDP Port=-1, id={-125 26 56 53 108 93 79 65 -81 -109 -91 -78 -56 -114 -102 18 }, payload={}, command={}, domain={-12 -74 -56 -66 -89 -124 65 -102 -77 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:02 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4008,{127, 0, 0, 1},4008, alive=1004, securePort=-1, UDP Port=-1, id={95 29 20 -57 42 69 69 -18 -71 -77 45 46 44 15 93 -78 }, payload={}, command={}, domain={-12 -74 -56 -66 -89 -124 65 -102 -77 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:02 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4009,{127, 0, 0, 1},4009, alive=1037, securePort=-1, UDP Port=-1, id={-85 60 -25 -78 104 -119 74 -32 -121 112 1 100 -56 81 -26 -127 }, payload={}, command={}, domain={-12 -74 -56 -66 -89 -124 65 -102 -77 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:03 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4011,{127, 0, 0, 1},4011, alive=1008, securePort=-1, UDP Port=-1, id={-101 -24 -123 0 -19 54 64 70 -98 32 -64 -61 -63 87 -68 -116 }, payload={}, command={}, domain={120 -60 -51 -19 63 -48 70 -27 -71 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:03 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4010,{127, 0, 0, 1},4010, alive=1034, securePort=-1, UDP Port=-1, id={4 80 -70 107 31 54 69 -46 -66 58 87 -103 41 -48 29 23 }, payload={}, command={}, domain={120 -60 -51 -19 63 -48 70 -27 -71 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:03 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Nov 06, 2023 10:05:03 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Nov 06, 2023 10:05:04 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Nov 06, 2023 10:05:04 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Nov 06, 2023 10:05:04 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4000] Nov 06, 2023 10:05:04 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Nov 06, 2023 10:05:04 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Nov 06, 2023 10:05:04 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4002,{127, 0, 0, 1},4002, alive=2529, securePort=-1, UDP Port=-1, id={-52 -110 -75 -61 1 -43 68 62 -118 34 -93 59 35 -78 71 -32 }, payload={}, command={}, domain={-12 -74 -56 -66 -89 -124 65 -102 -77 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:04 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=2569, securePort=-1, UDP Port=-1, id={-2 -32 -52 -85 16 -115 71 123 -72 82 -96 -45 52 62 20 12 }, payload={}, command={}, domain={-12 -74 -56 -66 -89 -124 65 -102 -77 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:04 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4004,{127, 0, 0, 1},4004, alive=2576, securePort=-1, UDP Port=-1, id={53 -14 8 -74 -31 -58 77 -97 -105 -66 -69 -26 -49 120 73 -103 }, payload={}, command={}, domain={-12 -74 -56 -66 -89 -124 65 -102 -77 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:04 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4006,{127, 0, 0, 1},4006, alive=2552, securePort=-1, UDP Port=-1, id={-78 -47 -118 -123 -117 -40 77 -80 -97 119 25 -3 -43 115 -45 -105 }, payload={}, command={}, domain={-12 -74 -56 -66 -89 -124 65 -102 -77 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:04 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4007,{127, 0, 0, 1},4007, alive=2509, securePort=-1, UDP Port=-1, id={-125 26 56 53 108 93 79 65 -81 -109 -91 -78 -56 -114 -102 18 }, payload={}, command={}, domain={-12 -74 -56 -66 -89 -124 65 -102 -77 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:04 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4009,{127, 0, 0, 1},4009, alive=2545, securePort=-1, UDP Port=-1, id={-85 60 -25 -78 104 -119 74 -32 -121 112 1 100 -56 81 -26 -127 }, payload={}, command={}, domain={-12 -74 -56 -66 -89 -124 65 -102 -77 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:04 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4011,{127, 0, 0, 1},4011, alive=2523, securePort=-1, UDP Port=-1, id={-101 -24 -123 0 -19 54 64 70 -98 32 -64 -61 -63 87 -68 -116 }, payload={}, command={}, domain={120 -60 -51 -19 63 -48 70 -27 -71 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:04 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4010,{127, 0, 0, 1},4010, alive=2542, securePort=-1, UDP Port=-1, id={4 80 -70 107 31 54 69 -46 -66 58 87 -103 41 -48 29 23 }, payload={}, command={}, domain={120 -60 -51 -19 63 -48 70 -27 -71 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:04 PM org.apache.catalina.tribes.io.BufferPool getBufferPool INFO: Created a buffer pool with max size:[104857600] bytes of type: [org.apache.catalina.tribes.io.BufferPool15Impl] Nov 06, 2023 10:05:05 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Nov 06, 2023 10:05:05 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=1002, securePort=-1, UDP Port=-1, id={-89 -1 122 41 75 74 68 38 -98 73 110 106 72 39 9 -29 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=1002, securePort=-1, UDP Port=-1, id={-89 -1 122 41 75 74 68 38 -98 73 110 106 72 39 9 -29 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4004,{127, 0, 0, 1},4004, alive=1001, securePort=-1, UDP Port=-1, id={-117 -35 114 -15 -104 3 64 57 -124 -103 16 -93 11 -113 -83 72 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4004,{127, 0, 0, 1},4004, alive=1001, securePort=-1, UDP Port=-1, id={-117 -35 114 -15 -104 3 64 57 -124 -103 16 -93 11 -113 -83 72 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4002,{127, 0, 0, 1},4002, alive=1008, securePort=-1, UDP Port=-1, id={-64 -41 -54 23 7 -98 78 -103 -118 -83 74 -62 49 23 39 2 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4003,{127, 0, 0, 1},4003, alive=1008, securePort=-1, UDP Port=-1, id={-95 86 -37 80 -80 -41 72 50 -83 77 115 -28 0 -92 120 84 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4002,{127, 0, 0, 1},4002, alive=1008, securePort=-1, UDP Port=-1, id={-64 -41 -54 23 7 -98 78 -103 -118 -83 74 -62 49 23 39 2 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4003,{127, 0, 0, 1},4003, alive=1008, securePort=-1, UDP Port=-1, id={-95 86 -37 80 -80 -41 72 50 -83 77 115 -28 0 -92 120 84 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4005,{127, 0, 0, 1},4005, alive=1012, securePort=-1, UDP Port=-1, id={-43 17 -32 34 52 -108 74 24 -66 15 -31 -21 -110 56 120 50 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4005,{127, 0, 0, 1},4005, alive=1012, securePort=-1, UDP Port=-1, id={-43 17 -32 34 52 -108 74 24 -66 15 -31 -21 -110 56 120 50 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4006,{127, 0, 0, 1},4006, alive=1009, securePort=-1, UDP Port=-1, id={-40 69 27 -49 85 -22 78 -89 -73 70 -53 112 8 -39 111 -100 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4007,{127, 0, 0, 1},4007, alive=1012, securePort=-1, UDP Port=-1, id={-50 -119 -126 -76 115 104 74 3 -127 27 101 -39 -14 -112 32 77 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4008,{127, 0, 0, 1},4008, alive=1005, securePort=-1, UDP Port=-1, id={-86 -1 49 -9 69 49 72 -114 -70 -15 17 87 -128 -9 -109 -88 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4009,{127, 0, 0, 1},4009, alive=1002, securePort=-1, UDP Port=-1, id={15 -50 -15 64 85 -107 70 -108 -128 -78 -36 -74 -84 84 -102 2 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4006,{127, 0, 0, 1},4006, alive=1009, securePort=-1, UDP Port=-1, id={-40 69 27 -49 85 -22 78 -89 -73 70 -53 112 8 -39 111 -100 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4007,{127, 0, 0, 1},4007, alive=1012, securePort=-1, UDP Port=-1, id={-50 -119 -126 -76 115 104 74 3 -127 27 101 -39 -14 -112 32 77 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4008,{127, 0, 0, 1},4008, alive=1005, securePort=-1, UDP Port=-1, id={-86 -1 49 -9 69 49 72 -114 -70 -15 17 87 -128 -9 -109 -88 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4009,{127, 0, 0, 1},4009, alive=1002, securePort=-1, UDP Port=-1, id={15 -50 -15 64 85 -107 70 -108 -128 -78 -36 -74 -84 84 -102 2 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4013,{127, 0, 0, 1},4013, alive=1002, securePort=-1, UDP Port=-1, id={-121 96 -91 -120 -70 -68 79 -114 -113 55 20 48 46 66 -31 -101 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4013,{127, 0, 0, 1},4013, alive=1002, securePort=-1, UDP Port=-1, id={-121 96 -91 -120 -70 -68 79 -114 -113 55 20 48 46 66 -31 -101 }, payload={}, command={}, domain={-47 78 71 -126 10 90 72 -46 -100 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:06 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Nov 06, 2023 10:05:07 PM org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread run WARNING: Error receiving mcast package. Sleeping 500ms java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@3ac827b7[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@3b68e31f[Wrapped task = org.apache.catalina.tribes.membership.McastServiceImpl$$Lambda$69/0x00000008010c1230@11431549]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@e84cfee[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 28] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) at org.apache.catalina.tribes.membership.McastServiceImpl.memberDataReceived(McastServiceImpl.java:432) at org.apache.catalina.tribes.membership.McastServiceImpl.receive(McastServiceImpl.java:380) at org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread.run(McastServiceImpl.java:580) Nov 06, 2023 10:05:08 PM org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread run WARNING: Error receiving mcast package. Sleeping 500ms java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@170f91d3[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@1fa3ff3e[Wrapped task = org.apache.catalina.tribes.membership.McastServiceImpl$$Lambda$69/0x00000008010c1230@240b08d2]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@e84cfee[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 28] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) at org.apache.catalina.tribes.membership.McastServiceImpl.memberDataReceived(McastServiceImpl.java:432) at org.apache.catalina.tribes.membership.McastServiceImpl.receive(McastServiceImpl.java:380) at org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread.run(McastServiceImpl.java:580) Nov 06, 2023 10:05:08 PM org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread run WARNING: Error receiving mcast package. Sleeping 500ms java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@149d6bd[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@169294bb[Wrapped task = org.apache.catalina.tribes.membership.McastServiceImpl$$Lambda$69/0x00000008010c1230@6a234323]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@e84cfee[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 28] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) at org.apache.catalina.tribes.membership.McastServiceImpl.memberDataReceived(McastServiceImpl.java:432) at org.apache.catalina.tribes.membership.McastServiceImpl.receive(McastServiceImpl.java:380) at org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread.run(McastServiceImpl.java:580) Nov 06, 2023 10:05:09 PM org.apache.catalina.tribes.group.interceptors.TcpFailureDetector memberDisappeared INFO: Received memberDisappeared[org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4000,{127, 0, 0, 1},4000, alive=2004, securePort=-1, UDP Port=-1, id={-75 -31 -26 80 64 31 65 22 -73 38 115 1 -119 -3 79 20 }, payload={67 104 97 110 110 101 108 45 50 ...(9)}, command={}, domain={-82 81 116 -8 -20 -11 74 -119 -117 ...(16)}]] message. Will verify. Nov 06, 2023 10:05:09 PM org.apache.catalina.tribes.group.interceptors.TcpFailureDetector memberDisappeared INFO: Verification complete. Member still alive[org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4000,{127, 0, 0, 1},4000, alive=2004, securePort=-1, UDP Port=-1, id={-75 -31 -26 80 64 31 65 22 -73 38 115 1 -119 -3 79 20 }, payload={67 104 97 110 110 101 108 45 50 ...(9)}, command={}, domain={-82 81 116 -8 -20 -11 74 -119 -117 ...(16)}]] Nov 06, 2023 10:05:09 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=1003, securePort=-1, UDP Port=-1, id={35 109 69 54 72 -77 65 -18 -120 41 106 -7 123 -69 32 78 }, payload={}, command={}, domain={-120 37 -114 -59 -43 -52 64 57 -107 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:09 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4010,{127, 0, 0, 1},4010, alive=1003, securePort=-1, UDP Port=-1, id={-50 96 -14 102 -45 96 67 60 -91 51 36 66 -35 73 -113 111 }, payload={}, command={}, domain={-120 37 -114 -59 -43 -52 64 57 -107 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:10 PM org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread run WARNING: Error receiving mcast package. Sleeping 500ms java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@43e9d9bb[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@14c0d220[Wrapped task = org.apache.catalina.tribes.membership.McastServiceImpl$$Lambda$69/0x00000008010c1230@2fd47531]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@e84cfee[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 28] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) at org.apache.catalina.tribes.membership.McastServiceImpl.memberDataReceived(McastServiceImpl.java:432) at org.apache.catalina.tribes.membership.McastServiceImpl.receive(McastServiceImpl.java:380) at org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread.run(McastServiceImpl.java:580) Nov 06, 2023 10:05:10 PM org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread run WARNING: Error receiving mcast package. Sleeping 500ms java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@46d68920[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@470e2dd8[Wrapped task = org.apache.catalina.tribes.membership.McastServiceImpl$$Lambda$69/0x00000008010c1230@4b7fa5f5]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@e84cfee[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 28] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) at org.apache.catalina.tribes.membership.McastServiceImpl.memberDataReceived(McastServiceImpl.java:432) at org.apache.catalina.tribes.membership.McastServiceImpl.receive(McastServiceImpl.java:380) at org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread.run(McastServiceImpl.java:580) Nov 06, 2023 10:05:11 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Nov 06, 2023 10:05:11 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4000] Nov 06, 2023 10:05:11 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Nov 06, 2023 10:05:11 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Nov 06, 2023 10:05:11 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=3506, securePort=-1, UDP Port=-1, id={35 109 69 54 72 -77 65 -18 -120 41 106 -7 123 -69 32 78 }, payload={}, command={}, domain={-120 37 -114 -59 -43 -52 64 57 -107 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:11 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4010,{127, 0, 0, 1},4010, alive=3506, securePort=-1, UDP Port=-1, id={-50 96 -14 102 -45 96 67 60 -91 51 36 66 -35 73 -113 111 }, payload={}, command={}, domain={-120 37 -114 -59 -43 -52 64 57 -107 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:12 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Nov 06, 2023 10:05:12 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Nov 06, 2023 10:05:13 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Nov 06, 2023 10:05:13 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Nov 06, 2023 10:05:13 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4002] Nov 06, 2023 10:05:13 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Nov 06, 2023 10:05:13 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Nov 06, 2023 10:05:13 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=5508, securePort=-1, UDP Port=-1, id={35 109 69 54 72 -77 65 -18 -120 41 106 -7 123 -69 32 78 }, payload={}, command={}, domain={-120 37 -114 -59 -43 -52 64 57 -107 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:13 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4010,{127, 0, 0, 1},4010, alive=5507, securePort=-1, UDP Port=-1, id={-50 96 -14 102 -45 96 67 60 -91 51 36 66 -35 73 -113 111 }, payload={}, command={}, domain={-120 37 -114 -59 -43 -52 64 57 -107 ...(16)}]] was refused to join cluster Nov 06, 2023 10:05:14 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Nov 06, 2023 10:05:14 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Nov 06, 2023 10:05:14 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Nov 06, 2023 10:05:15 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Nov 06, 2023 10:05:15 PM org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread run WARNING: Error receiving mcast package. Sleeping 500ms java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@d6f0c8c[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@79767fc[Wrapped task = org.apache.catalina.tribes.membership.McastServiceImpl$$Lambda$69/0x00000008010c1230@950897e]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@486d8345[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 6] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) at org.apache.catalina.tribes.membership.McastServiceImpl.memberDataReceived(McastServiceImpl.java:432) at org.apache.catalina.tribes.membership.McastServiceImpl.receive(McastServiceImpl.java:380) at org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread.run(McastServiceImpl.java:580) Nov 06, 2023 10:05:15 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Nov 06, 2023 10:05:15 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4000] Nov 06, 2023 10:05:15 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Nov 06, 2023 10:05:15 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Nov 06, 2023 10:05:16 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Nov 06, 2023 10:05:16 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Nov 06, 2023 10:05:17 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Nov 06, 2023 10:05:17 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Nov 06, 2023 10:05:17 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4001] Nov 06, 2023 10:05:17 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Nov 06, 2023 10:05:17 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Nov 06, 2023 10:05:18 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Nov 06, 2023 10:05:18 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Nov 06, 2023 10:05:19 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Nov 06, 2023 10:05:19 PM org.apache.catalina.tribes.transport.nio.ParallelNioSender doLoop WARNING: Member send is failing for:[tcp://{127, 0, 0, 1}:4001] ; Setting to suspect and retrying. Nov 06, 2023 10:05:19 PM org.apache.catalina.tribes.group.interceptors.TcpFailureDetector memberDisappeared INFO: Received memberDisappeared[org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=2029, securePort=-1, UDP Port=-1, id={37 18 26 40 -21 123 68 -3 -78 -119 9 67 111 95 18 20 }, payload={67 104 97 110 110 101 108 45 50 ...(9)}, command={}, domain={8 -71 75 52 75 -102 69 78 -73 ...(16)}]] message. Will verify. Nov 06, 2023 10:05:19 PM org.apache.catalina.tribes.group.interceptors.TcpFailureDetector memberDisappeared INFO: Verification complete. Member disappeared[org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=2029, securePort=-1, UDP Port=-1, id={37 18 26 40 -21 123 68 -3 -78 -119 9 67 111 95 18 20 }, payload={67 104 97 110 110 101 108 45 50 ...(9)}, command={}, domain={8 -71 75 52 75 -102 69 78 -73 ...(16)}]] Nov 06, 2023 10:05:19 PM org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread run WARNING: Error receiving mcast package. Sleeping 500ms java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@67c30377[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@26fe094c[Wrapped task = org.apache.catalina.tribes.membership.McastServiceImpl$$Lambda$69/0x00000008010c1230@22c1894b]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@8c1d8e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 2] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) at org.apache.catalina.tribes.membership.McastServiceImpl.memberDataReceived(McastServiceImpl.java:432) at org.apache.catalina.tribes.membership.McastServiceImpl.receive(McastServiceImpl.java:380) at org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread.run(McastServiceImpl.java:580) ------------- ---------------- --------------- Testcase: testTcpMcastFail took 9.48 sec Testcase: testTcpFailureMemberAdd took 4.219 sec Testcase: testTcpSendFailureMemberDrop took 4.183 sec