Testsuite: org.apache.catalina.tribes.group.interceptors.TestTcpFailureDetector Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.923 sec ------------- Standard Output --------------- testTcpMcastFail() Channel-2:member added[Channel-1] Channel-1:member added[Channel-2] testTcpFailureMemberAdd() Channel-2:member added[Channel-1] testTcpSendFailureMemberDrop() Channel-2:member added[Channel-1] Channel-1:member added[Channel-2] Channel-1:member disappeared[Channel-2] ------------- ---------------- --------------- ------------- Standard Error ----------------- Apr 18, 2024 3:22:38 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Apr 18, 2024 3:22:38 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4012] Apr 18, 2024 3:22:38 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Apr 18, 2024 3:22:38 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Apr 18, 2024 3:22:38 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=1023, securePort=-1, UDP Port=-1, id={-105 49 8 104 13 106 70 -23 -69 64 -124 32 80 -67 103 -89 }, payload={}, command={}, domain={2 86 -55 -93 9 77 79 -95 -92 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:38 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4002,{127, 0, 0, 1},4002, alive=1026, securePort=-1, UDP Port=-1, id={113 -117 -114 15 16 27 69 -26 -82 92 16 86 105 -61 -56 -90 }, payload={}, command={}, domain={2 86 -55 -93 9 77 79 -95 -92 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:38 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4003,{127, 0, 0, 1},4003, alive=1012, securePort=-1, UDP Port=-1, id={2 -81 25 -126 26 -54 75 -98 -120 -16 80 -39 -103 -83 -102 -103 }, payload={}, command={}, domain={2 86 -55 -93 9 77 79 -95 -92 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:38 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4005,{127, 0, 0, 1},4005, alive=1009, securePort=-1, UDP Port=-1, id={-21 -115 92 -9 101 112 78 24 -95 -40 66 -18 -42 -120 -108 -34 }, payload={}, command={}, domain={2 86 -55 -93 9 77 79 -95 -92 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:38 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4004,{127, 0, 0, 1},4004, alive=1019, securePort=-1, UDP Port=-1, id={-58 -104 -107 -115 -43 -42 66 -37 -84 -15 -9 -33 -56 -106 -83 -20 }, payload={}, command={}, domain={2 86 -55 -93 9 77 79 -95 -92 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:38 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4006,{127, 0, 0, 1},4006, alive=1017, securePort=-1, UDP Port=-1, id={-119 -127 -69 92 -65 -45 75 115 -67 -122 -106 22 -84 -119 31 125 }, payload={}, command={}, domain={2 86 -55 -93 9 77 79 -95 -92 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:38 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4000,{127, 0, 0, 1},4000, alive=1014, securePort=-1, UDP Port=-1, id={-78 -9 -108 -68 -118 75 71 83 -93 50 -1 -23 -120 127 -31 2 }, payload={}, command={}, domain={2 86 -55 -93 9 77 79 -95 -92 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:38 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4008,{127, 0, 0, 1},4008, alive=1017, securePort=-1, UDP Port=-1, id={-14 -67 -33 -99 105 -106 69 -42 -90 61 24 -95 -55 85 100 -26 }, payload={}, command={}, domain={2 86 -55 -93 9 77 79 -95 -92 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:38 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4007,{127, 0, 0, 1},4007, alive=1015, securePort=-1, UDP Port=-1, id={-24 -65 17 -55 58 -119 64 118 -81 -38 34 62 126 33 99 -18 }, payload={}, command={}, domain={2 86 -55 -93 9 77 79 -95 -92 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:38 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4009,{127, 0, 0, 1},4009, alive=1047, securePort=-1, UDP Port=-1, id={-100 -121 24 3 -16 -60 73 -64 -83 -46 12 97 13 35 -72 -61 }, payload={}, command={}, domain={2 86 -55 -93 9 77 79 -95 -92 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:38 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4011,{127, 0, 0, 1},4011, alive=1014, securePort=-1, UDP Port=-1, id={49 0 -34 43 -123 21 78 116 -72 83 26 -102 -51 -32 105 39 }, payload={}, command={}, domain={-102 -28 46 -123 -116 28 74 -28 -103 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:38 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4010,{127, 0, 0, 1},4010, alive=1018, securePort=-1, UDP Port=-1, id={104 -99 24 -16 120 -51 72 38 -109 10 -78 34 32 -1 105 -82 }, payload={}, command={}, domain={-102 -28 46 -123 -116 28 74 -28 -103 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:39 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Apr 18, 2024 3:22:39 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Apr 18, 2024 3:22:40 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Apr 18, 2024 3:22:40 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Apr 18, 2024 3:22:40 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4000] Apr 18, 2024 3:22:40 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Apr 18, 2024 3:22:40 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Apr 18, 2024 3:22:40 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4007,{127, 0, 0, 1},4007, alive=2541, securePort=-1, UDP Port=-1, id={-24 -65 17 -55 58 -119 64 118 -81 -38 34 62 126 33 99 -18 }, payload={}, command={}, domain={2 86 -55 -93 9 77 79 -95 -92 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:40 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4005,{127, 0, 0, 1},4005, alive=2566, securePort=-1, UDP Port=-1, id={-21 -115 92 -9 101 112 78 24 -95 -40 66 -18 -42 -120 -108 -34 }, payload={}, command={}, domain={2 86 -55 -93 9 77 79 -95 -92 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:40 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4003,{127, 0, 0, 1},4003, alive=2590, securePort=-1, UDP Port=-1, id={2 -81 25 -126 26 -54 75 -98 -120 -16 80 -39 -103 -83 -102 -103 }, payload={}, command={}, domain={2 86 -55 -93 9 77 79 -95 -92 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:40 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4008,{127, 0, 0, 1},4008, alive=2562, securePort=-1, UDP Port=-1, id={-14 -67 -33 -99 105 -106 69 -42 -90 61 24 -95 -55 85 100 -26 }, payload={}, command={}, domain={2 86 -55 -93 9 77 79 -95 -92 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:40 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4004,{127, 0, 0, 1},4004, alive=2585, securePort=-1, UDP Port=-1, id={-58 -104 -107 -115 -43 -42 66 -37 -84 -15 -9 -33 -56 -106 -83 -20 }, payload={}, command={}, domain={2 86 -55 -93 9 77 79 -95 -92 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:40 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4009,{127, 0, 0, 1},4009, alive=2557, securePort=-1, UDP Port=-1, id={-100 -121 24 3 -16 -60 73 -64 -83 -46 12 97 13 35 -72 -61 }, payload={}, command={}, domain={2 86 -55 -93 9 77 79 -95 -92 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:40 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4011,{127, 0, 0, 1},4011, alive=2522, securePort=-1, UDP Port=-1, id={49 0 -34 43 -123 21 78 116 -72 83 26 -102 -51 -32 105 39 }, payload={}, command={}, domain={-102 -28 46 -123 -116 28 74 -28 -103 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:40 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4010,{127, 0, 0, 1},4010, alive=2530, securePort=-1, UDP Port=-1, id={104 -99 24 -16 120 -51 72 38 -109 10 -78 34 32 -1 105 -82 }, payload={}, command={}, domain={-102 -28 46 -123 -116 28 74 -28 -103 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:40 PM org.apache.catalina.tribes.io.BufferPool getBufferPool INFO: Created a buffer pool with max size:[104857600] bytes of type: [org.apache.catalina.tribes.io.BufferPool15Impl] Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4002,{127, 0, 0, 1},4002, alive=1005, securePort=-1, UDP Port=-1, id={73 -109 -44 107 52 -26 65 121 -90 -47 -62 -94 100 120 98 74 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4002,{127, 0, 0, 1},4002, alive=1005, securePort=-1, UDP Port=-1, id={73 -109 -44 107 52 -26 65 121 -90 -47 -62 -94 100 120 98 74 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=1011, securePort=-1, UDP Port=-1, id={125 -100 99 -9 96 -96 73 96 -84 112 -122 30 -106 90 -34 -86 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=1014, securePort=-1, UDP Port=-1, id={125 -100 99 -9 96 -96 73 96 -84 112 -122 30 -106 90 -34 -86 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4003,{127, 0, 0, 1},4003, alive=1018, securePort=-1, UDP Port=-1, id={48 -60 -125 -52 -24 -57 71 21 -81 -71 6 -92 39 -15 54 118 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4003,{127, 0, 0, 1},4003, alive=1018, securePort=-1, UDP Port=-1, id={48 -60 -125 -52 -24 -57 71 21 -81 -71 6 -92 39 -15 54 118 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4004,{127, 0, 0, 1},4004, alive=1030, securePort=-1, UDP Port=-1, id={-59 90 4 31 -44 101 77 76 -113 108 31 -103 74 -22 56 38 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4004,{127, 0, 0, 1},4004, alive=1030, securePort=-1, UDP Port=-1, id={-59 90 4 31 -44 101 77 76 -113 108 31 -103 74 -22 56 38 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4005,{127, 0, 0, 1},4005, alive=1032, securePort=-1, UDP Port=-1, id={-126 -4 21 -3 6 4 68 -74 -124 79 -76 41 6 -54 97 -107 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4006,{127, 0, 0, 1},4006, alive=1005, securePort=-1, UDP Port=-1, id={39 -4 -99 127 61 117 71 110 -95 -38 79 -114 -119 -2 75 -57 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4007,{127, 0, 0, 1},4007, alive=1008, securePort=-1, UDP Port=-1, id={33 11 -11 -43 -73 126 74 -12 -94 102 -97 -92 97 37 -21 -64 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4005,{127, 0, 0, 1},4005, alive=1032, securePort=-1, UDP Port=-1, id={-126 -4 21 -3 6 4 68 -74 -124 79 -76 41 6 -54 97 -107 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4008,{127, 0, 0, 1},4008, alive=1002, securePort=-1, UDP Port=-1, id={123 13 114 -10 -21 54 73 36 -83 90 -80 89 91 -84 -97 97 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4009,{127, 0, 0, 1},4009, alive=1012, securePort=-1, UDP Port=-1, id={112 14 -10 -61 94 -7 75 -116 -113 -24 -118 -68 15 71 -16 -122 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4013,{127, 0, 0, 1},4013, alive=1001, securePort=-1, UDP Port=-1, id={118 -90 -117 -81 -96 -107 79 40 -125 39 -100 93 -4 46 36 11 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4006,{127, 0, 0, 1},4006, alive=1005, securePort=-1, UDP Port=-1, id={39 -4 -99 127 61 117 71 110 -95 -38 79 -114 -119 -2 75 -57 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4007,{127, 0, 0, 1},4007, alive=1008, securePort=-1, UDP Port=-1, id={33 11 -11 -43 -73 126 74 -12 -94 102 -97 -92 97 37 -21 -64 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4008,{127, 0, 0, 1},4008, alive=1002, securePort=-1, UDP Port=-1, id={123 13 114 -10 -21 54 73 36 -83 90 -80 89 91 -84 -97 97 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4009,{127, 0, 0, 1},4009, alive=1012, securePort=-1, UDP Port=-1, id={112 14 -10 -61 94 -7 75 -116 -113 -24 -118 -68 15 71 -16 -122 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:41 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4013,{127, 0, 0, 1},4013, alive=1001, securePort=-1, UDP Port=-1, id={118 -90 -117 -81 -96 -107 79 40 -125 39 -100 93 -4 46 36 11 }, payload={}, command={}, domain={-68 41 -15 105 -9 -38 76 -96 -105 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:42 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Apr 18, 2024 3:22:43 PM org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread run WARNING: Error receiving mcast package. Sleeping 500ms java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@7f3e2362[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@29d30c7d[Wrapped task = org.apache.catalina.tribes.membership.McastServiceImpl$$Lambda$69/0x00000008010c1230@42039df5]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@2e9181e3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 26] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) at org.apache.catalina.tribes.membership.McastServiceImpl.memberDataReceived(McastServiceImpl.java:432) at org.apache.catalina.tribes.membership.McastServiceImpl.receive(McastServiceImpl.java:380) at org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread.run(McastServiceImpl.java:580) Apr 18, 2024 3:22:44 PM org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread run WARNING: Error receiving mcast package. Sleeping 500ms java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@2237761d[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@74b912ea[Wrapped task = org.apache.catalina.tribes.membership.McastServiceImpl$$Lambda$69/0x00000008010c1230@251e302d]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@2e9181e3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 26] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) at org.apache.catalina.tribes.membership.McastServiceImpl.memberDataReceived(McastServiceImpl.java:432) at org.apache.catalina.tribes.membership.McastServiceImpl.receive(McastServiceImpl.java:380) at org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread.run(McastServiceImpl.java:580) Apr 18, 2024 3:22:44 PM org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread run WARNING: Error receiving mcast package. Sleeping 500ms java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@16539aa0[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@5b064ecf[Wrapped task = org.apache.catalina.tribes.membership.McastServiceImpl$$Lambda$69/0x00000008010c1230@fcd82da]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@2e9181e3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 26] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) at org.apache.catalina.tribes.membership.McastServiceImpl.memberDataReceived(McastServiceImpl.java:432) at org.apache.catalina.tribes.membership.McastServiceImpl.receive(McastServiceImpl.java:380) at org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread.run(McastServiceImpl.java:580) Apr 18, 2024 3:22:45 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=1002, securePort=-1, UDP Port=-1, id={-20 -123 116 -122 -82 -20 74 24 -75 -64 120 79 49 -3 71 -124 }, payload={}, command={}, domain={-87 50 -16 17 40 -2 69 64 -101 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:45 PM org.apache.catalina.tribes.group.interceptors.TcpFailureDetector memberDisappeared INFO: Received memberDisappeared[org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4000,{127, 0, 0, 1},4000, alive=2012, securePort=-1, UDP Port=-1, id={5 12 -25 7 126 30 64 -54 -120 -30 -121 -21 -59 7 -58 -93 }, payload={67 104 97 110 110 101 108 45 50 ...(9)}, command={}, domain={68 57 63 93 104 -118 75 37 -114 ...(16)}]] message. Will verify. Apr 18, 2024 3:22:45 PM org.apache.catalina.tribes.group.interceptors.TcpFailureDetector memberDisappeared INFO: Verification complete. Member still alive[org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4000,{127, 0, 0, 1},4000, alive=2012, securePort=-1, UDP Port=-1, id={5 12 -25 7 126 30 64 -54 -120 -30 -121 -21 -59 7 -58 -93 }, payload={67 104 97 110 110 101 108 45 50 ...(9)}, command={}, domain={68 57 63 93 104 -118 75 37 -114 ...(16)}]] Apr 18, 2024 3:22:45 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4003,{127, 0, 0, 1},4003, alive=1004, securePort=-1, UDP Port=-1, id={95 39 42 -52 14 21 79 76 -98 -120 60 21 -71 63 109 -94 }, payload={}, command={}, domain={-87 50 -16 17 40 -2 69 64 -101 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:46 PM org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread run WARNING: Error receiving mcast package. Sleeping 500ms java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@447c839b[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@19d81129[Wrapped task = org.apache.catalina.tribes.membership.McastServiceImpl$$Lambda$69/0x00000008010c1230@1ad266f0]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@2e9181e3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 26] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) at org.apache.catalina.tribes.membership.McastServiceImpl.memberDataReceived(McastServiceImpl.java:432) at org.apache.catalina.tribes.membership.McastServiceImpl.receive(McastServiceImpl.java:380) at org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread.run(McastServiceImpl.java:580) Apr 18, 2024 3:22:47 PM org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread run WARNING: Error receiving mcast package. Sleeping 500ms java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@5b4f2f9c[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@3238e28a[Wrapped task = org.apache.catalina.tribes.membership.McastServiceImpl$$Lambda$69/0x00000008010c1230@5aad6a8a]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@2e9181e3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 26] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) at org.apache.catalina.tribes.membership.McastServiceImpl.memberDataReceived(McastServiceImpl.java:432) at org.apache.catalina.tribes.membership.McastServiceImpl.receive(McastServiceImpl.java:380) at org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread.run(McastServiceImpl.java:580) Apr 18, 2024 3:22:47 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Apr 18, 2024 3:22:47 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4000] Apr 18, 2024 3:22:47 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Apr 18, 2024 3:22:47 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Apr 18, 2024 3:22:47 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4003,{127, 0, 0, 1},4003, alive=3513, securePort=-1, UDP Port=-1, id={95 39 42 -52 14 21 79 76 -98 -120 60 21 -71 63 109 -94 }, payload={}, command={}, domain={-87 50 -16 17 40 -2 69 64 -101 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:47 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=3521, securePort=-1, UDP Port=-1, id={-20 -123 116 -122 -82 -20 74 24 -75 -64 120 79 49 -3 71 -124 }, payload={}, command={}, domain={-87 50 -16 17 40 -2 69 64 -101 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:48 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Apr 18, 2024 3:22:48 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Apr 18, 2024 3:22:49 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Apr 18, 2024 3:22:49 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Apr 18, 2024 3:22:49 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4002] Apr 18, 2024 3:22:49 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Apr 18, 2024 3:22:49 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Apr 18, 2024 3:22:49 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4003,{127, 0, 0, 1},4003, alive=5514, securePort=-1, UDP Port=-1, id={95 39 42 -52 14 21 79 76 -98 -120 60 21 -71 63 109 -94 }, payload={}, command={}, domain={-87 50 -16 17 40 -2 69 64 -101 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:49 PM org.apache.catalina.tribes.group.interceptors.DomainFilterInterceptor memberAdded INFO: Member [org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=5522, securePort=-1, UDP Port=-1, id={-20 -123 116 -122 -82 -20 74 24 -75 -64 120 79 49 -3 71 -124 }, payload={}, command={}, domain={-87 50 -16 17 40 -2 69 64 -101 ...(16)}]] was refused to join cluster Apr 18, 2024 3:22:50 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Apr 18, 2024 3:22:50 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Apr 18, 2024 3:22:50 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Apr 18, 2024 3:22:51 PM org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread run WARNING: Error receiving mcast package. Sleeping 500ms java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@4b5c123f[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@41a4794f[Wrapped task = org.apache.catalina.tribes.membership.McastServiceImpl$$Lambda$69/0x00000008010c1230@4f639f0b]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@e5e9530[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 6] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) at org.apache.catalina.tribes.membership.McastServiceImpl.memberDataReceived(McastServiceImpl.java:432) at org.apache.catalina.tribes.membership.McastServiceImpl.receive(McastServiceImpl.java:380) at org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread.run(McastServiceImpl.java:580) Apr 18, 2024 3:22:51 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Apr 18, 2024 3:22:51 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Apr 18, 2024 3:22:51 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4000] Apr 18, 2024 3:22:51 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Apr 18, 2024 3:22:51 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Apr 18, 2024 3:22:52 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Apr 18, 2024 3:22:52 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Apr 18, 2024 3:22:53 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Apr 18, 2024 3:22:53 PM org.apache.catalina.tribes.group.GroupChannel start WARNING: No utility executor was set, creating one Apr 18, 2024 3:22:53 PM org.apache.catalina.tribes.transport.ReceiverBase bind INFO: Receiver Server Socket bound to:[localhost/127.0.0.1:4001] Apr 18, 2024 3:22:53 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket INFO: Setting cluster mcast soTimeout to [500] Apr 18, 2024 3:22:53 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4] Apr 18, 2024 3:22:54 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[4] Apr 18, 2024 3:22:54 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8] Apr 18, 2024 3:22:55 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers INFO: Done sleeping, membership established, start level:[8] Apr 18, 2024 3:22:55 PM org.apache.catalina.tribes.transport.nio.ParallelNioSender doLoop WARNING: Member send is failing for:[tcp://{127, 0, 0, 1}:4001] ; Setting to suspect and retrying. Apr 18, 2024 3:22:55 PM org.apache.catalina.tribes.group.interceptors.TcpFailureDetector memberDisappeared INFO: Received memberDisappeared[org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=2014, securePort=-1, UDP Port=-1, id={-19 -17 54 -24 76 92 64 77 -80 -42 28 120 -27 -2 -113 43 }, payload={67 104 97 110 110 101 108 45 50 ...(9)}, command={}, domain={-62 -69 34 82 -39 93 66 -118 -124 ...(16)}]] message. Will verify. Apr 18, 2024 3:22:55 PM org.apache.catalina.tribes.group.interceptors.TcpFailureDetector memberDisappeared INFO: Verification complete. Member disappeared[org.apache.catalina.tribes.membership.MemberImpl[tcp://{127, 0, 0, 1}:4001,{127, 0, 0, 1},4001, alive=2014, securePort=-1, UDP Port=-1, id={-19 -17 54 -24 76 92 64 77 -80 -42 28 120 -27 -2 -113 43 }, payload={67 104 97 110 110 101 108 45 50 ...(9)}, command={}, domain={-62 -69 34 82 -39 93 66 -118 -124 ...(16)}]] Apr 18, 2024 3:22:55 PM org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread run WARNING: Error receiving mcast package. Sleeping 500ms java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@7ec98622[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@3ff48c19[Wrapped task = org.apache.catalina.tribes.membership.McastServiceImpl$$Lambda$69/0x00000008010c1230@3bcb1f3f]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@54f204b8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 2] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) at org.apache.catalina.tribes.membership.McastServiceImpl.memberDataReceived(McastServiceImpl.java:432) at org.apache.catalina.tribes.membership.McastServiceImpl.receive(McastServiceImpl.java:380) at org.apache.catalina.tribes.membership.McastServiceImpl$ReceiverThread.run(McastServiceImpl.java:580) ------------- ---------------- --------------- Testcase: testTcpMcastFail took 9.455 sec Testcase: testTcpFailureMemberAdd took 4.265 sec Testcase: testTcpSendFailureMemberDrop took 4.192 sec