| 48 Collaborator |
|
Brandon Williams , Štefan Miklošovič , Caleb Rackliffe , Andrés de la Peña , Berenguer Blasi , Ekaterina Dimitrova , Marcus Eriksson , David Capwell , Sam Tunnicliffe , Josh McKenzie , Jacek Lewandowski , Benjamin Lerer , Branimir Lambov , Jon Meredith , Francisco Guerrero , Maxim Muzafarov , Dinesh Joshi , Aleksey Yeschenko , Brad Schoening , Mike Adamson , Doug Rohrer , Ariel Weisberg , Andy Tolbert , Aleksei Zotov , Maxwell Guo , Abe Ratnofsky , Jeremiah Jordan , Claude Warren , Runtian Liu , Ethan Brown , Derek Chen-Becker , nvharikrishna , Jaydeepkumar Chovatia , Aleksandr Volochnev , Tiago Alves , Artem Chekunov , Aleks Volochnev , shunsaker , reviewed by Caleb Rackliffe , jaydeepkumar1984 , ayushis , Tiago L. Alves , Shayne Hunsaker , Sam Tunnicliffe (in-jvm-dtest fix) , Kan Maung , Henrik Ingo , Ayushi Singh , Andrés de la Peña García |
| 76 Patch |
83 Review |
|
89fe2223b4e1118dbd11cfd00f2a7b7d12940502,
f5df4b219e063cb24b9cc0c22b6e614506b8d903,
2480a7e7ee64791acec6add38e134753b95236fd,
2fb578263c82b115da27cbbccfab50e0de62afd0,
f3e7413159d737a41a82750b9c93b44274575337,
461b8c42d24b6906332949fa6f1bf110d08b7f06,
3c85def5cc8bbd93e0c16554e9ae5fdc6badf24f,
f7c11bdcd458b2eb0769a4b76698fb6382cdab3a,
f0655159e692816a2703e2a0ff6c9458f90cab75,
ce49e775f783a3c2615e5d3ffdb04889732c1ebc,
e163146fd90f34c03ac8c2d58101f277874cc971,
136c8c0f65cc8f2db87bb683e6eaceb05016f00e,
2801ed33662577b6a736b5bdb55f1e20fa08c6db,
69a6dc61a89aac96b9f9a2a7aef958452e14384e,
b4f1c6d250991fc27c5f87a2dc0fd81e7ad0d272,
cada1a13c8b77fc672d67d754912cf28a7120e3c,
f7c11bdcd458b2eb0769a4b76698fb6382cdab3a,
987d03c142f086f05857f9c6a2eafef7e157eb15,
4bbfd64fcd7ff208c8cc3833ffff00aea015d2a8,
3bf9bd6831ae23670f0113b5d858e4dc00448ce5,
f5df4b219e063cb24b9cc0c22b6e614506b8d903,
41a669a100646abbcccc2f41bdfe0a11db648b1b,
4555b94345aa7183902bf1b5a54ad40fce13d432,
d2f6b8acb626250d456030d43542a11a8a56e151,
29ed31542bc7503c7c5695ce8012a555b4b3fb6f,
7ca806c60a3e080d740fb163c639bb76a520f6ab,
d7352209b214559cea944b5df564b653a3379e3a,
86604f50388d7e2cec68196fcf5f82a334e68ae2,
f01d2b4a3ca114ac58d95befcab3dbbad9d960aa,
c100d34a1a1d497eee85ca10c5cc1e43eb4871c4,
3804b14d17bcd1a48ae54c6bc0ef29d878db9278,
a4214574b034b285bade77e229b80a9604232b3c,
54b601119091712b35729e4e57e80c9db555bc8b,
2b17c1293056068bb3e94c332d6fb99df6a0b0fa,
ffe973c740338f1dc5b161cac98ef55ce5bb5157,
24d6b291eeb8842fab22b5b3936539b66a036d86,
eb518f3ca6f22753346dfb57c94e9935611c6a53,
0085d21bc687995478e338302e619e82ad4a4644,
4b7b860e7b4351cb72ae7f28908aebce644a89cd,
d1e2244a7794c26d428ac93747c77db2432c24b0,
b2f885f512acd069c4fe74be00848b8fdec8f579,
c7e77df4b460b24d5d42ae6836903ce642f4e651,
1da18efb2ffd3f9efc3b8b178b2a8d38a6831056,
50210570fb0d442178faf214db1dc035b20469c1,
d0e435304d5b04ebc782fc58ac38eed8720f4e51,
52053200e75d3e6718c03bfa68232dfb94f9a566,
24a677ac420ec64b98164c37a346dc5384582a7c,
79602451c9efb05fd16f09249823ebe8049e01e2,
3801a9b00884279a3e8c095b1cf6fb920ac76fa8,
54f5a983738a1580fbbe43bdb7201ff9b2664401,
196e0213cdeff8410c8ea8516b9ac0782a0e6f2f,
d0c68e02fa235fd2218a40684a10c9573fcb001c,
7e7071d185a2038d4bacdebb76d3c08e0c6f1cad,
f863946da1b8ea6f7624c62471c055416b377143,
207d6cee2d01552f794d322ec05a7577bcab08e0,
e9c5f42a15136314ae35f247aaabdc8a13a0b0cd,
45f2425dd2ec861b33943c819f3cc31644d1ce18,
520fe09821e6fc80f3d840d607f2c42b5d408d19,
2049e854f5aec3dac39c45a29f4368db82b72cfb,
8d11eeabd7825e63f883c68ffa2b67a02c1bed1c,
08c43bf46135b5ec63e488f22f4737a1c8434eda,
b626e79275b9451506082b70d222d3895caf0882,
4e67b753d5d37dd18316d1a4b4144a8f75f80274,
80ffdb45f248c6c0af78fdf31de9d3f1b86b72dc,
de1e2375426429c0ec917352f478adfab3867234,
68ac01038d28e9e534d50d04c970bfca706515d2,
9ffe201ce0d33dd544c85030c2261883ac73aadc,
7e205252a001b9316efe98da329d26e3b62c1df9,
16a025c86ede72e04a6cf32d2cc1d989c2b74e02,
7823fdc014a3029cf72a8f5804b2f764493619b4,
1af3812c0fddeaf22260d8164d5d87a377e2116b,
31a735b2ec74124a32d97a9207e229dda65331db,
d2d15cee9c417e502e29a1a92ded6efa31b92707,
5207a25a8eeb994419aa3746aeb55fdd62a0708d,
4d11d17fe73872b4cd4ddf58cfddc745e0d528c9,
c29f6802329df0ef40f4a415e9e9fa2ad94c2c7e |
e4c97f1925da17e146598b11bea4cbdbaceb5fd7,
3755934e5224a6e9f826a0a594d415c36465d449,
ad26ffcd577a09c07fe92bd3ce78ee33dfe0a191,
0dea9c268a023b0bb78784c815dec23575f9c30f,
5c51f05dab0562c3b95b60224e4698e2a30d2ce7,
df0b13970198fcf7079a1044c5911d8ba0b6dac3,
7572725defd4d5bba12097046b8338a955d8d032,
90fe8608a401dd086c8918a045d01ff288849f49,
0bcc3549920aa218750dabdceb734430a3942882,
70ec86c5762aee300739e40e1ea23dc9d8b1b819,
426eebb5139ab67b30914ed6202c25d181ab239e,
e5c919f273e886daf0e85b0e268ec25f48b1be75,
5e4ff921afb9d8cb2deacbfd24db78ea4e2ccbe1,
b8c54362931b817a84c91f8d758aa63995ecb4a1,
176ce395bb42c102a8df080ecd26559ab0c93b13,
50d94f4b462b7a3c4415cf508d6a8eff7bd5d32f,
2dea5c75882ee2caaaac0ae5b84f9d6b66c46b2e,
b4f1c6d250991fc27c5f87a2dc0fd81e7ad0d272,
f2c41accf847a4e8eb2529cad0408ff220c40683,
aca11d4fc3e5938510dc48c071b49e6d22f54497,
5d46ff27968050e51425083fc3ab8b7d4a51fcd5,
6a7bef12ecdf59e3a67c81b89c13e3c2bf7e19d8,
a9e6ed37874f2240039086309e7849bea42c07e2,
c26f2a3d6936d6ff2f14c6ab19b3727c2f86c941,
55fecfb65e6db9dccc0895e0d30a01f42832f6b8,
4d61359c214fbe8ee8b8edc822cad79f98b337bc,
0e4c2f4befa22caa68b34f95d0169b4685bc7e0d,
359700dde20f8e53cae61735cf1ea88138c670ef,
c4d11c4372906ae1dea9e6c31c1136f122e8a1b2,
b57c13603afe699a918edd7ea1e8fdb46f0c1166,
87c2af85c1305c130af7d66f83dec03a1c4a8bb2,
4f232324ba030ff640a790b4029d9f722e96872b,
5bdfd790b7b8cc638a96efb5c34181ece35b04a1,
6ab45971fc651f78c8748f80e3cd6d4a1b6dbc50,
6b885a44c39ff3abcd5cb6c6c44eaa4004979aa7,
ad26ffcd577a09c07fe92bd3ce78ee33dfe0a191,
aafb4d19448f12ce600dc4e84a5b181308825b32,
0bcf4a199207966cfa892feb91541345edba181b,
65c99bfc42015ccfbcbc8963b3fb3c2a761ea053,
bb36090fa0858456fb1ba80adf71fb3dc24a1aac,
b3256f5bf22c99a8f5410634dd41ca1643a34c1c,
a0ec0ae303443b1d1cbfe845d94fccfb38123f8c,
a8b1fb6ae6e934f4ba0a07deb03b6257c7dcb383,
6c90950489a42a38a6ddfa45f79c84a110dffbe7,
c100d34a1a1d497eee85ca10c5cc1e43eb4871c4,
230fe8e64722ac02dbf8cdafb7d4fef120726dd7,
6247c9d966d7e3886fef0c7486013578407b37e4,
2eac2590bfe85b76c5fc1ea7c818082e124f5ed5,
302c6fcf59c5fa9fcd475b2c811ad57ae7c45f49,
9f56bf4ca7fdb61ad09e5f2ad09b87cd01e0716b,
c51a7c66fc21ca2da08b89ae5f9b4817ee4d8c23,
6d5203615f7a9670cb1698b74123666bc25ba471,
23138252f20891c26a3692664c6affaf99e86541,
1315d0c96f4625a76296f58d431f97669e5178c2,
ed48f3c017c5e572a523890bcd5b7c798d7eb358,
755fd9446b084e659e98bd7336b9e910c2e12577,
d85f7f7c2dd4b9bbdb44bc96235e6a8bc3ff3967,
b9e2ab75f8f6dedd45c6ad7a83b3160149869262,
a3258d66bcc9f946304c19d59e75d2721126303e,
5bb4bab12f8edfef95ed13cbabf8c0f377986065,
db9f7a67ec4b03413c10034956e2cf18739ca4b1,
d543dae2cd0d6540d95eb3252d79e75393fd993d,
0a6be7e4128406a0e3e0f85b54c5e8cae3cd7052,
7a46854f160918fec24b984a55505b510390f4ab,
8cb278e2cd0fd9979334090d940f91e9ec60c17a,
b3c4d981d465f59de601425689015bcb323d32ad,
f41ee663f4e79d4adc5ae5e02d39b75478908115,
365085bbd76ee717e265598fd83c6f4c39e1f1e6,
69bf679445eefecae0308405fc8425d71c8ca77e,
36649072de261b318ab07272608c8339369d0ad1,
efdd222343e76a9660716af2126ef7b348e18624,
bfec30a837bdaf52564f4c1fdfc5aae110f525eb,
049703f5a66c55e77e7e392ff89c57ff06024e76,
3708168724aa4937cdfeaa843bdb3820039ad15e,
cd6533401282e0455f87ba4d4a58bfec18fde4dc,
3935906a685640b2f6a2058b38fdf45d917edfc9,
55b1a08cc4b81458a37876bd285f4b27c16dc659,
2aea316f85e68b4e4739b61260faf5ed91552d5f,
7f13011c5da7ced49d851d4573839392728078d2,
36924a2c2193fe0e27000ada9308ebf79a0aee98,
cf4a46721c937911cbf5df10dc6d24d8826c26e4,
cbd7dc9262e68c2cfe83649fb74d75c4266628ef,
51a654f0bddc6d8a0db03132698dd5229f425752 |
426eebb5139ab67b30914ed6202c25d181ab239e | Author: Runtian Liu <curlylrt@gmail.com>
| 2024-10-18 10:51:45-05:00
A node should always return back the full information about itself for gossip regardless the asked heartbeat version
patch by Runtian Liu; reviewed by Brandon Williams, Michael Semb Wever for CASSANDRA-19983
2801ed33662577b6a736b5bdb55f1e20fa08c6db | Author: mck <mck@apache.org>
| 2024-10-16 10:10:09+02:00
Add new cassandra_latest.yaml entries to latest tests
Both CASSANDRA-18120 and CASSANDRA-19946 updated cassandra_latest.yaml but not the corresponding test configs
patch by Mick Semb Wever; reviewed by Brandon Williams, Tiago L. Alves for CASSANDRA-20002
69a6dc61a89aac96b9f9a2a7aef958452e14384e | Author: mck <mck@apache.org>
| 2024-10-11 16:48:34+02:00
Prevent CQLTester fuzz testing from using illegal commitlog_disk_access_mode combinations
Also provide a clearer message from DatabaseDescriptor about the failing combination
patch by Mick Semb Wever; reviewed by David Capwell, Štefan Miklošovič for CASSANDRA-19812
176ce395bb42c102a8df080ecd26559ab0c93b13 | Author: Caleb Rackliffe <calebrackliffe@gmail.com>
| 2024-10-09 14:52:40-05:00
Always write local expiration time as an int to LivenessInfo digest
patch by Caleb Rackliffe; reviewed by Mick Semb Wever, David Capwell, and Marcus Eriksson for CASSANDRA-19989
50d94f4b462b7a3c4415cf508d6a8eff7bd5d32f | Author: Tiago Alves <tiago.alves@datastax.com>
| 2024-10-07 10:56:46+01:00
Enables IAuthenticator's to return own AuthenticateMessage
Allows custom implementations of IAuthenticator to return their own
AuthenticateMessage based on ClientState information.
ClientState contains information about driver's name and version which
could be used to determine the contents of the AuthenticateMessage that
is sent back to the clients. This enables, for instance, returning
driver's known authenticator implementations (e.g. DseAuthenticator)
which enables SASL negotiation.
patch by Tiago Alves; reviewed by Mick Semb Wever, Andy Tolbert for CASSANDRA-19984
2fb578263c82b115da27cbbccfab50e0de62afd0 | Author: Mick Semb Wever <mck@apache.org>
| 2024-09-28 17:59:56+03:00
Exclude intensive dtests when not running dtest-upgrade*-large
Also add dtest-large-latest
patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-19963
2dea5c75882ee2caaaac0ae5b84f9d6b66c46b2e | Author: Tiago Alves <tiago.alves@datastax.com>
| 2024-09-24 10:27:40+01:00
Use ParameterizedClass for all auth-related implementations
Uses ParameterizedClass for IAuthorizer, INetworkAuthorizer, and
IRoleManager implementations enabling those to be configurable from
parameters specified directly in cassandra.yaml.
Opportunistically makes consistent the initialization and setting of
all auth-related implementations and removes code duplication.
Notes:
* IInternodeAuthenticator implementations are expected to be set as
default directly in DatabaseDescriptor instead of done via
AuthConfig.applyAuth(). This is assumed in tests and client logic.
For instance ReconnectableSnitchHelperTest fetches this authenticator
before calling daemonInitialize(). Also, BulkLoader fetches this
directly when creating an outbound connection.
* Changing this behavior in BulkLoader causes a cascade of changes.
First, one would need to add AuthConfig.applyAuth() directly in
clientInitialize() and then would need to enable all the additional
classes that this change causes. Long term this might be justified
as if we're depending on the auth logic to be properly set. However,
in the context of this change it was decided to postpone further
changes.
* Standardize auth-related configurations by using a short-form with
the class name instead of the full qualified class name containing
the package name.
patch by Tiago Alves; reviewed by Mick Semb Wever, Stefan Miklosovic for CASSANDRA-19946
e5c919f273e886daf0e85b0e268ec25f48b1be75 | Author: jaydeepkumar1984 <chovatia.jaydeep@gmail.com>
| 2024-09-15 14:22:55-07:00
Add nodetool checktokenmetadata command that checks TokenMetadata is insync with Gossip endpointState
patch by Jaydeepkumar Chovatia; reviewed by Brandon Williams, Mick Semb Wever for CASSANDRA-18758
f3e7413159d737a41a82750b9c93b44274575337 | Author: mck <mck@apache.org>
| 2024-07-29 09:15:07+02:00
Reduce timeouts in upgrade_through_versions_test due to ccm downloads/building
In docker we want to use the existing populated ~/.ccm/repositories but don't want to write to the container's filesystem (it can leak fd). So we set CCM_CONFIG_DIR to be in the run-python-dtest.XXXXXX tmpdir. Previously this was done in the base (non-docker) script, but this is only needed in docker (and outside of docker we want the normal ~/.ccm usage)
patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-19813
2b17c1293056068bb3e94c332d6fb99df6a0b0fa | Author: Mick Semb Wever <mck@apache.org>
| 2024-07-20 22:34:16+02:00
ninja-fix – tmp avoid current_5_0_x (LooseVersion cant do `5.0-rc1 > 5.0.1` comparisons)
ref: https://the-asf.slack.com/archives/CK23JSY2K/p1721508701444629
b8c54362931b817a84c91f8d758aa63995ecb4a1 | Author: shunsaker <shaynehunsaker@gmail.com>
| 2024-07-10 02:03:35+02:00
Add configurable batchlog endpoint strategies
Batchlog endpoint strategy was previously only random placements on other racks. Options now are random_remote, prefer_local, dynamic_remote, and dynamic.
patch by Shayne Hunsaker; reviewed by Mick Semb Wever, Brandon Williams for CASSANDRA-18120
f2c41accf847a4e8eb2529cad0408ff220c40683 | Author: Doug Rohrer <jeetkundoug@apache.org>
| 2024-06-28 16:56:03-04:00
CASSANDRA-19783 - InstanceClassLoader leak detection
This commit (along with the related in-jvm-dtest API change) adds the ability for ResourceLeakTest
to actually detect InstanceClassLoader leaks in 3 loops. In order to find these in CI:
- Pull in the in-jvm dtest API changes in 0.17.0
- Enable the looperEverythingTest to run (but not the others, which remain ignored)
In addition, this commit updates netty to 4.1.113 as the version
of netty previously used (4.1.96) caused a classloader leak (fixed in
Netty 4.1.98)
Patch by Doug Rohrer and Sam Tunnicliffe (in-jvm-dtest fix); reviewed by Mick Semb Wever for CASSANDRA-19783
and CASSANDRA-19239
461b8c42d24b6906332949fa6f1bf110d08b7f06 | Author: Mick Semb Wever <mck@apache.org>
| 2024-06-08 15:00:04+02:00
Remove sid source from debian, was only needed for jdk8
- Added debug in testing
- Propagate the $DEBUG env from docker to test scripts
- Be verbose when a pipeline errors that not all tests would have been run
- add timeout to each cell stage (scripts on a node can hang and the only alternative was to abort the whole pipeline)
patch by Mick Semb Wever; reviewed by Ekaterina Dimitrova, Brandon Williams for CASSANDRA-19708
cada1a13c8b77fc672d67d754912cf28a7120e3c | Author: Mick Semb Wever <mck@apache.org>
| 2024-04-09 00:11:20+02:00
Vector search should be able to restrict on clustering keys when filtering isn't required
patch by Mick Semb Wever; reviewed by Caleb Rackliffe for CASSANDRA-19544
3c85def5cc8bbd93e0c16554e9ae5fdc6badf24f | Author: Mick Semb Wever <mck@apache.org>
| 2024-04-06 10:48:04+02:00
Honour parameter defaults between builds in Jenkinsfile
Also
– increase splits for jvm-dtests, container size and docker limits for simulator-dtest
– print exit status in .build/docker/run-tests.sh and .build/docker/_docker_init_tests.sh
– add a summary list of test failures in ci_summary.html
– in ubuntu2004_test.docker make sure /home/cassandra exists and has correct perms (from Marcuse)
– when on ci-cassandra, replace use of copyArtifacts in Jenkinsfile generateTestReports() with manual wget of test files (copyArtifacts is notoriously slow, >4hrs in this case)
– copy ci_summary.html and results_details.tar.xz to nightlies
– capture generateTestReports logs
– stream xz where possible, instead of xz compressing afterwards
– fix ant version in centos7-build.docker
– remove docker login (was meangingless, if credentials exist then docker is logged in)
– prefetch docker images from jfrog (to reduce dockerhub pull rate limits), relates to CASSANDRA-18931
– use scripts from cassandra-builds to clean and report on agents, relates to CASSANDRA-18130
– use groovy elvis operators to avoid NPEs/failures on blank param values
– parallel jfrog pulls and cache it in jfrog too
– pin alpine docker image version
– don't stash .git (was causing AccessDeniedException on some unstash), needed fix so deb/rpm packaging worked on not-git work directories
– durabilityHint needs PERFORMANCE_OPTIMIZED, controller becomes scale bottleneck and breaks without it
patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-19558
520fe09821e6fc80f3d840d607f2c42b5d408d19 | Author: Mick Semb Wever <mck@apache.org>
| 2024-01-21 15:17:57+01:00
ninja-fix python default for 5+ builds is now 3.8 (CASSANDRA-19245)
- fix github urls
- improve docker pruning when builds finish
- add comment to update intree docker images after each release
6a7bef12ecdf59e3a67c81b89c13e3c2bf7e19d8 | Author: Mike Adamson <madamson@datastax.com>
| 2023-11-28 10:48:23+00:00
Fix SAI intersection queries
- Fix comparison in PostingListRangeIterator for updating skip token
- Fix binary search in KeyLookup.clusteredSeekToKey
- Added new on-disk component for storing partition sizes by partition ID
patch by Mike Adamson; reviewed by Caleb Rackliffe, Mick Semb Wever for CASSANDRA-19011
eb518f3ca6f22753346dfb57c94e9935611c6a53 | Author: Mick Semb Wever <mck@apache.org>
| 2023-11-26 22:18:45+01:00
Add version guard around call to initializecms also in upgrade_tests/storage_engine_upgrade_test.py
patch by Mick Semb Wever; reviewed by Sam Tunnicliffe for CASSANDRA-19099
a9e6ed37874f2240039086309e7849bea42c07e2 | Author: Mike Adamson <madamson@datastax.com>
| 2023-11-24 15:26:00+00:00
Fix broken indexing tests when using SAI
- This fixes a number of broken tests when the default index is set to SAI
- Composite partition indexes were being filtered prior to row filtering in the
index searcher resulting in incorrect results
- Static and non-static index intersection was failing because static primary keys
were not comparing correctly against non-static primary keys
patch by Mike Adamson; reviewed by Andres de la Peña, Michael Semb Wever for CASSANDRA-19034
365085bbd76ee717e265598fd83c6f4c39e1f1e6 | Author: Bereng <berenguerblasi@gmail.com>
| 2023-11-23 08:35:59+01:00
Test failure: dtest-novnode.disk_balance_test.TestDiskBalance.test_disk_balance_stress
Patch by Berenguer Blasi; reviewed by Ekaterina Dimitrova, Michael Semb Wever for CASSANDRA-18947
55fecfb65e6db9dccc0895e0d30a01f42832f6b8 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2023-11-20 15:32:40-05:00
Fix BulkLoaderTest.testBulkLoader_WithArgs2
patch by Ekaterina Dimitrova; reviewed by Michael Semb Wever and Andres de la Pena for CASSANDRA-19000
f0655159e692816a2703e2a0ff6c9458f90cab75 | Author: Mick Semb Wever <mck@apache.org>
| 2023-11-13 18:34:44+01:00
Add to jenkins pipeline: test-oa, test-system-keyspace-directory, test-trie, jvm-dtest-novnode, jvm-dtest-upgrade-novnode simulator-dtest, dtest-large-novnode, dtest-upgrade-large, dtest-upgrade-novnode, dtest-upgrade-novnode-large.
patch by Mick Semb Wever; reviewed by Berenguer Blasi, Brandon Williams for CASSANDRA-17989, CASSANDRA-18008, CASSANDRA-17145, CASSANDRA-18003
359700dde20f8e53cae61735cf1ea88138c670ef | Author: Stefan Miklosovic <smiklosovic@apache.org>
| 2023-11-08 14:06:26+01:00
Create / update tests to ensure commit logs and hints for all versions in MessagingService are ingestible by 5.0
Patches for 3.0, 3.11, 4.0 and 4.1 are just adding HintsMaker class to generate hint files.
Patches for 5.0 and trunk are adding tests for commit log upgrading and hints which were generated by HintsMaker.
Patches for 5.0 and trunk are also adding version 1 in HintsDescriptor back as it was removed in CASSANDRA-18314 by mistake.
patch by Stefan Miklosovic; reviewed by Michael Semb Wever for CASSANDRA-19002
0e4c2f4befa22caa68b34f95d0169b4685bc7e0d | Author: Bereng <berenguerblasi@gmail.com>
| 2023-11-07 07:24:57+01:00
Default to nb instead of nc for sstable formats
patch by Berenguer Blasi; reviewed by Francisco Guerrero, Jacek Lewandowski, Michael Semb Wever for CASSANDRA-19010
0085d21bc687995478e338302e619e82ad4a4644 | Author: Mick Semb Wever <mck@apache.org>
| 2023-11-04 19:58:05+01:00
Release 5.0-alpha2
ref: https://lists.apache.org/thread/5861bzk3swf7wvm2jwczgsfsskvlsqjc
c4d11c4372906ae1dea9e6c31c1136f122e8a1b2 | Author: Mike Adamson <madamson@datastax.com>
| 2023-10-30 09:46:52+00:00
Fix VectorUpdateDeleteTest for JDK 17
Removed use of reflection and directly set
relevant property to avoid jdk 17 errors
patch by Mike Adamson; reviewed by Stefan Miklosovic, Michael Semb Wever and Andrés de la Peña for CASSANDRA-18715
5d46ff27968050e51425083fc3ab8b7d4a51fcd5 | Author: Claude Warren <claude.warren@aiven.io>
| 2023-10-25 13:00:50+02:00
Remove dependency on Sigar in favor of OSHI
patch by Claude Warren; reviewed by Stefan Miklosovic, Jacek Lewandowski, Michael Semb Wever for CASSANDRA-16565
Co-authored-by: Stefan Miklosovic <smiklosovic@apache.org>
70ec86c5762aee300739e40e1ea23dc9d8b1b819 | Author: Bereng <berenguerblasi@gmail.com>
| 2023-10-19 09:24:23+02:00
Repeatable test runs, and named command line options, for test scripts
Each test type has a -repeat suffixed companion, used with the `-e REPEATED_TESTS_COUNT` option.
patch by Berenguer Blasi; reviewed by Mick Semb Wever, Brandon Williams for CASSANDRA-18942
8d11eeabd7825e63f883c68ffa2b67a02c1bed1c | Author: Mick Semb Wever <mck@apache.org>
| 2023-10-09 13:04:00+02:00
ninja-fix – warn instead of failing if the pipeline build fails generating the unified xml test report file fails (xslt xerces easily OOMs)
ref: https://the-asf.slack.com/archives/CK23JSY2K/p1696599019480519
b57c13603afe699a918edd7ea1e8fdb46f0c1166 | Author: Stefan Miklosovic <smiklosovic@apache.org>
| 2023-10-06 12:54:05+02:00
Remove byteman-related files from production sources
This patch also removes compress-lzf library (leftover from CASSANDRA-12229)
as well as it makes byte-buddy dependencies to be test scoped.
patch by Stefan Miklosovic; reviewed by Michael Semb Wever for CASSANDRA-18877
4b7b860e7b4351cb72ae7f28908aebce644a89cd | Author: Mick Semb Wever <mck@apache.org>
| 2023-09-13 09:43:46+02:00
Add @pytest.mark.no_vnodes to upgrade_tests/cql_tests that are using an ordered partitioner
And fix storage_engine_upgrade_test.py and upgrade_through_versions_test.py so node2 has same dc as node1
patch by Mick Semb Wever; reviewed by Brandon Williams, Ekaterina Dimitrova, Josh McKenzie, Maxim Muzafarov for CASSANDRA-18832
987d03c142f086f05857f9c6a2eafef7e157eb15 | Author: Mick Semb Wever <mck@apache.org>
| 2023-09-09 21:14:10+02:00
Fixes for in-tree scripts: offline mode, maybe-build for fqltool-test, jvm-dtest-upgrade
- jvm-dtest-upgrade script running in ci-cassandra.a.o (needs default bash)
- add offline mode (to avoid `git fetch` before building dtest-jars on other branches),
- avoid rebuilding in fqltool-test target, as is standard for test targets.
- python detection and override
- FileTest cleanup (tmp directory was left unreadable and undeletable)
- reuse ~/.ccm (like normal)
- remove support for python 3.6
- remove docker volumes in image (they are added at run time)
- remove superfluousjava version debug
– extra mount for build/tmp as hack to prevent buggy hardlinks on overlay
patch by Mick Semb Wever; reviewed by Brandon Williams, Ekaterina Dimitrova, Josh McKenzie, Maxim Muzafarov for CASSANDRA-18665
d1e2244a7794c26d428ac93747c77db2432c24b0 | Author: Mick Semb Wever <mck@apache.org>
| 2023-09-09 12:24:52+02:00
Add 5.0-alpha1 to upgrade_manifest.py and upgrade_through_versions_test.py
upgrade_through_versions_test.py should have been updated when the cassandra-5.0 branch was created and trunk version bumped to 5.1
patch by Mick Semb Wever; reviewed by Brandon Williams, Ekaterina Dimitrova for CASSANDRA-18832
e4c97f1925da17e146598b11bea4cbdbaceb5fd7 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2023-08-25 13:36:32-04:00
CircleCI: Fix BASE_BRANCH in generate.sh
patch by Ekaterina Dimitrova; reviewed by Andres de la Pena and Michael Semb Wever for CASSANDRA-18797
4d61359c214fbe8ee8b8edc822cad79f98b337bc | Author: Jacek Lewandowski <lewandowski.jacek@gmail.com>
| 2023-08-22 10:47:29+02:00
CASSANDRA-18785: Add support for Sonar analysis
Patch by Jacek Lewandowski; reviewed by Brandon Williams, Maxim Muzafarov, Michael Semb Wever, Stefan Miklosovic for CASSANDRA-18785
b2f885f512acd069c4fe74be00848b8fdec8f579 | Author: Mick Semb Wever <mck@apache.org>
| 2023-08-20 10:43:36+02:00
Cassandra release 3.11.16
ref: https://lists.apache.org/thread/myxc4y31v755srwxnx02bvwzjkyxxzg5
87c2af85c1305c130af7d66f83dec03a1c4a8bb2 | Author: Ethan Brown <ethan.brown@datastax.com>
| 2023-08-18 13:02:15-07:00
Fix delayed SSTable release with unsafe_aggressive_sstable_expiration
patch by Ethan Brown; reviewed by Branimir Lambov and Mick Semb Wever for CASSANDRA-18756
89fe2223b4e1118dbd11cfd00f2a7b7d12940502 | Author: Mick Semb Wever <mck@apache.org>
| 2023-08-06 00:13:43+03:00
Update trunk to version 5.1
- update jvm-dtest supported upgrade paths
- update circeci and in-tree scripts to build 5.0 dtest jar
- update in-tree scripts for better repetitive testing of jvm-dtest-upgrade tests
- fix jvm-dtest-upgrade tests that broke with 5.0 -> 5.1 upgrades
- update docs trunk -> 5.0
patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-18705
5bdfd790b7b8cc638a96efb5c34181ece35b04a1 | Author: Caleb Rackliffe <calebrackliffe@gmail.com>
| 2023-08-01 14:53:07-05:00
Ensure that SSTablesSystemViewTest compacts to a single SSTable in testVirtualTableThroughIndexLifeCycle even w/ UCS
patch by Caleb Rackliffe; reviewed by Mick Semb Wever for CASSANDRA-18703
b626e79275b9451506082b70d222d3895caf0882 | Author: Mick Semb Wever <mck@apache.org>
| 2023-07-27 14:07:18+02:00
ninja-fix – only build dtest jars on branches the current jdk works with (trunk doesn't build w/ 8 anymore)
6b885a44c39ff3abcd5cb6c6c44eaa4004979aa7 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2023-07-21 11:09:02-04:00
Fix MemtableSizeTestBase#testSize (now MemtableSizeTest#testSize) was not running in CI
patch by Ekaterina Dimitrova; reviewed by Brandon Williams and Michael Semb Wever for CASSANDRA-18329
3755934e5224a6e9f826a0a594d415c36465d449 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2023-07-17 16:11:17-04:00
Drop JDK8 and add JDK17, remove eclipse-warnings in favor of Checker Framework and upgrade checkstyle
patch by Ekaterina Dimitrova; reviewed by Jeremiah Jordan, Berenguer Blasi, Michael Semb Wever and Jacek Lewandowski for CASSANDRA-18255
ad26ffcd577a09c07fe92bd3ce78ee33dfe0a191 | Author: Jacek Lewandowski <lewandowski.jacek@gmail.com>
| 2023-07-17 12:22:33+02:00
Run checks in a separate task and fix build warnings
Patch by Jacek Lewandowski; reviewed by Mick Semb Wever and Stefan Miklosovic for CASSANDRA-18618
ad26ffcd577a09c07fe92bd3ce78ee33dfe0a191 | Author: Jacek Lewandowski <lewandowski.jacek@gmail.com>
| 2023-07-17 12:22:33+02:00
Run checks in a separate task and fix build warnings
Patch by Jacek Lewandowski; reviewed by Mick Semb Wever and Stefan Miklosovic for CASSANDRA-18618
1da18efb2ffd3f9efc3b8b178b2a8d38a6831056 | Author: Mick Semb Wever <mck@apache.org>
| 2023-07-16 13:15:43+02:00
Fix upgrade_through_versions_test.py::TestUpgrade* tests
Make run the generated upgrade_through_versions_test tests on pytest >7.2.0
pytest-7.2.0 changed how markers were inherited, https://github.com/pytest-dev/pytest/issues/7792
Replace the marker with runtime pytest.skip call to ensure generated tests are run but not the base class.
Remove how internode_ssl was changing seeds to append the ssl storage port, it's not needed as the tests always already set enable_legacy_ssl_storage_port to true.
Filter upgrade steps by what JDKs they require and what the current JDK is (or what JAVA<jdk_version>_HOME vars are defined).
Replace any version in the multi-step upgrade path with the current code (when it matches). This enables forward upgrade testing.
patch by Mick Semb Wever; reviewed by Brandon Williams, Jacek Lewandowski for CASSANDRA-18499
4e67b753d5d37dd18316d1a4b4144a8f75f80274 | Author: Mick Semb Wever <mck@apache.org>
| 2023-07-12 19:46:04+02:00
ninja-fix all occurrences of "java.version.11" got remove in trunk with ac25943. use CASSANDRA_USE_JDK11 instead.
6ab45971fc651f78c8748f80e3cd6d4a1b6dbc50 | Author: ayushis <ayushis@netflix.com>
| 2023-07-10 15:21:07-07:00
Introduce pluggable crypto providers and default to Amazon Corretto Crypto Provider
patch by Ayushi Singh; reviewed by Stefan Miklosovic, Michael Semb Wever and Maxim Muzafarov for CASSANDRA-18624
Co-authored-by: Stefan Miklosovic <smiklosovic@apache.org>
f7c11bdcd458b2eb0769a4b76698fb6382cdab3a | Author: Mick Semb Wever <mck@apache.org>
| 2023-06-13 16:07:07+02:00
Standalone Jenkinsfile
– ensure test file paths, and their suite names are unique (the latter was broken for cqlshlib and python dtests)
– removal of properties and system-out in test xml happens in CassandraXMLJUnitResultFormatter
– new jenkins agent labels and introduce agents sizes
- ci_summary.html generation script, ref work submitted in apache/cassandra-builds#99
– fix for stress-test and fqltool-test running on small
- ant generate-test-report is limited to only running on individual test types (ci_parser.py provides ci_summary.html for the overview now)
- each cell has a single retry, and the retry will happen on a different agent
- on ci-cassandra the summary stage happens on the builtin, bc copyArtifacts on 15k+ files takes many hours otherwise
- test-burn only needs two splits
- dependency-check is disabled from the lint target until CASSANDRA-19213
- add $DEBUG env var to in-tree scripts, turns on bash debug
- fix FBUtilities' handling of gcp cos_containerd (kernel version comes with a trailing '+' character)
patch by Aleks Volochnev, Mick Semb Wever; reviewed by Aleksandr Volochnev, Josh McKenzie, Maxim Muzafarov, Stefan Miklosovic for CASSANDRA-18594
Co-authored-by: Aleksandr Volochnev <a.volochnev@gmail.com>
Co-authored-by: Mick Semb Wever <mck@apache.org>
Co-authored-by: Josh McKenzie <jmckenzie@apache.org>
Co-authored-by: Artem Chekunov <artem.v.chekunov@gmail.com>
f7c11bdcd458b2eb0769a4b76698fb6382cdab3a | Author: Mick Semb Wever <mck@apache.org>
| 2023-06-13 16:07:07+02:00
Standalone Jenkinsfile
– ensure test file paths, and their suite names are unique (the latter was broken for cqlshlib and python dtests)
– removal of properties and system-out in test xml happens in CassandraXMLJUnitResultFormatter
– new jenkins agent labels and introduce agents sizes
- ci_summary.html generation script, ref work submitted in apache/cassandra-builds#99
– fix for stress-test and fqltool-test running on small
- ant generate-test-report is limited to only running on individual test types (ci_parser.py provides ci_summary.html for the overview now)
- each cell has a single retry, and the retry will happen on a different agent
- on ci-cassandra the summary stage happens on the builtin, bc copyArtifacts on 15k+ files takes many hours otherwise
- test-burn only needs two splits
- dependency-check is disabled from the lint target until CASSANDRA-19213
- add $DEBUG env var to in-tree scripts, turns on bash debug
- fix FBUtilities' handling of gcp cos_containerd (kernel version comes with a trailing '+' character)
patch by Aleks Volochnev, Mick Semb Wever; reviewed by Aleksandr Volochnev, Josh McKenzie, Maxim Muzafarov, Stefan Miklosovic for CASSANDRA-18594
Co-authored-by: Aleksandr Volochnev <a.volochnev@gmail.com>
Co-authored-by: Mick Semb Wever <mck@apache.org>
Co-authored-by: Josh McKenzie <jmckenzie@apache.org>
Co-authored-by: Artem Chekunov <artem.v.chekunov@gmail.com>
4555b94345aa7183902bf1b5a54ad40fce13d432 | Author: Mick Semb Wever <mck@apache.org>
| 2023-05-26 13:40:51+02:00
ninja-fix FullQueryLoggerTest, requires allow_nodetool_archive_command false to begin with CASSANDRA-18550
d2f6b8acb626250d456030d43542a11a8a56e151 | Author: Mick Semb Wever <mck@apache.org>
| 2023-05-26 13:40:51+02:00
ninja-fix FullQueryLoggerTest, requires allow_nodetool_archive_command false to begin with CASSANDRA-18550
9ffe201ce0d33dd544c85030c2261883ac73aadc | Author: mck <mick@thelastpickle.com>
| 2023-05-25 17:37:56+02:00
Debian packaging source should exclude git subdirectory, bullseye sources reduced, add docker unsecured for git cloning
patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-18552
41a669a100646abbcccc2f41bdfe0a11db648b1b | Author: Mick Semb Wever <mck@apache.org>
| 2023-05-16 16:04:39+02:00
Deduplicate the MixedMode* upgrade jvm-dtests
Also update method parameters to be clearer in how we declare testcase applicability
patch by Mick Semb Wever; reviewed by David Capwell for CASSANDRA-18506
d0e435304d5b04ebc782fc58ac38eed8720f4e51 | Author: Mick Semb Wever <mck@apache.org>
| 2023-04-25 19:21:29+02:00
Set upgrade_manifest.CONFIG when running normal dtests, and restore 2.1 -> 3.x upgrade path as valid
patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-17869
65c99bfc42015ccfbcbc8963b3fb3c2a761ea053 | Author: Henrik Ingo <henrik.ingo@avoinelama.fi>
| 2023-04-19 17:34:23+03:00
Improve 'Not enough space for compaction' logging messages
Adds separate WARN level messages to the check itself in Directories.
patch by Henrik Ingo; reviewed by Mick Semb Wever, Brad Schoening, Claude Warren, Kan Maung, maxwellguo for CASSANDRA-18260
29ed31542bc7503c7c5695ce8012a555b4b3fb6f | Author: Mick Semb Wever <mck@apache.org>
| 2023-04-13 13:21:16+02:00
Improve apidocs and pre-conditions to how upgrade paths are included in jvm-dtest-upgrade (UpgradeTestBase)
Also add a comment that any protocol version bump should also update upgrade_through_versions_test.py
patch by Mick Semb Wever; reviewed by Brandon Williams, Ekaterina Dimitrova for CASSANDRA-17869
52053200e75d3e6718c03bfa68232dfb94f9a566 | Author: Mick Semb Wever <mck@apache.org>
| 2023-04-11 14:42:47+02:00
Fixes for JDK17
- add 4.1 latest release to dtest upgrade paths, and use the correct JDK on all paths
- limit upgrade paths where they have been defined explicitly, with @since
- in upgrade paths, replace trunk with 4.0 where that was the intention
- set_node_to_current_version(node) now asserts that the upgrade taking place is a supported upgrade path
- include upgrading through to 5.0 in test_upgrade_super_columns_through_all_versions
- fix TestProtoV4* tests to include 4.0 and 4.1
- add TestProtoV5*
- remove current_2_1_x
- TestUpgradeSuperColumnsThrough.test_sparse_supercolumn is only run in 3.11 and 4.x
- TestSCUpgrade.test_upgrade_super_columns_through_all_versions is only run on upgrade paths between2.2 andd 4.1 (inclusive)
patch by Mick Semb Wever; reviewed by Brandon Williams, Ekaterina Dimitrova for CASSANDRA-17869
24a677ac420ec64b98164c37a346dc5384582a7c | Author: Mick Semb Wever <mck@apache.org>
| 2023-03-11 23:32:22+01:00
Configure auditlog and fqltool tests to do chronicle-queue file-shrinking synchronously
patch by Mick Semb Wever; reviewed by Ekaterina Dimitrova for CASSANDRA-18049
5c51f05dab0562c3b95b60224e4698e2a30d2ce7 | Author: Brandon Williams <brandonwilliams@apache.org>
| 2023-03-10 09:47:56-06:00
Remove JAVA8/JAVA11_HOME from circle configs
Patch by brandonwilliams; reviewed by edimitrova and mck for
CASSANDRA-18106
efdd222343e76a9660716af2126ef7b348e18624 | Author: Brandon Williams <brandonwilliams@apache.org>
| 2023-03-02 11:18:26-06:00
disable jdk switching
Patch by brandonwilliams; reviewed by edimitrova and mck for
CASSANDRA-18106
79602451c9efb05fd16f09249823ebe8049e01e2 | Author: Mick Semb Wever <mck@apache.org>
| 2023-02-25 11:29:37+01:00
Change trunk from 4.2 to 5.0
Use parent sha to run against 4.2-SNAPSHOT versions of trunk.
patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-17973
7ca806c60a3e080d740fb163c639bb76a520f6ab | Author: Mick Semb Wever <mck@apache.org>
| 2023-02-25 11:25:35+01:00
Change trunk from 4.2 to 5.0
– update MessagingService (remove the 4.1 version that was only a placeholder in test code bc serialisation test files were previously incorrectly serialising random UUIds for TimeUUIDs)
– update upgrade jvm-dtests
– remove older serialization binary files we are no longer testing against
patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-17973
a0ec0ae303443b1d1cbfe845d94fccfb38123f8c | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2023-02-09 15:00:05-05:00
Remove scripted UDFs, remove related tests or rewrite some tests to create java UDFs instead, where it makes sense
patch by Ekaterina Dimitrova; reviewed by Michael Semb Wever for CASSANDRA-18252
86604f50388d7e2cec68196fcf5f82a334e68ae2 | Author: Mick Semb Wever <mck@apache.org>
| 2023-01-21 12:46:56+01:00
Prepare for JDK17 experimental support
Removes the use of CASSANDRA_USE_JDK11 and introduces the build.xml properties `java.default` and `java.supported`.
patch by Mick Semb Wever; reviewed by Ekaterina Dimitrova for CASSANDRA-18179
6c90950489a42a38a6ddfa45f79c84a110dffbe7 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2023-01-19 20:30:43-05:00
Fix tests post JDK-8210522 (rewrite reflection of "modifiers" field)
patch by Ekaterina Dimitrova; reviewed by Michael Semb Wever for CASSANDRA-18181
df0b13970198fcf7079a1044c5911d8ba0b6dac3 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2022-12-22 17:21:48-05:00
Use CircleCI Large executor instead of XLarge executor in MIDRES config for Python upgrade tests
patch by Ekaterina Dimitrova; reviewed by Michael Semb Wever for CASSANDRA-18127
f5df4b219e063cb24b9cc0c22b6e614506b8d903 | Author: Mick Semb Wever <mck@apache.org>
| 2022-12-18 01:16:16-08:00
Move build and test scripts in-tree, under .build/
See .build/README.md .Build and test scripts cover all CI activities in an CI agnostic manner. Scripts are found in non-docker and dockerised variants.
The non-docker scripts are found first under .build/ .These interact directly with ant, providing additional checks and environment setup. It is intended that what can be pushed down into the base ant build layer should be. The
debian and redhat build scripts are hidden under .build/docker because they are generally not usuable outside of their corresponding linux dists, and we don't want to encourage anything to the contrary. Bring the artifact/deb/rpm
build scripts (and associated docker images) from cassandra-builds repo to the .build directory. These packaging script for debian and redhat are now separated from the artifacts scripts. An additional build script check-code.sh
has been added that is solely responsible for all linter and code checks (includes owasp dependency checker). Only JDK11 and JDK17 are supported (as JDK8 is soon to be dropped). Scripts do not clean (or realclean) so that
scripts can be better pipelined, but `ant jar` was required to be added to circleci and ci-cassandra.a.o cqlsh-tests. Scripts can define a custom BUILD_DIR (build.dir) which can permit running parrallel builds off the same source
(though not all tests support this, or their support for it has atrophied). All build and test artifacts, results, and logs are found under build/ (or the BUILD_DIR). The build local venv and .ccm directories are now also
created under build (or BUILD_DIR). The test venv, logs and results are wiped each run. Use a separate mktemp directory each run, under /tmp (respect /tmp responsibility, and python fails when tmpdir is on a docker volume).
Don't set CASSANDRA_HOME when running python dtests (and fail-fast if `ant artifacts` was used to build instead of `ant jar`).
The docker scripts are found lower down under .build/docker/ .These scripts re-used the non-docker scripts inside containers. The docker images are versioned controlled in the same directory as dockerfiles, and tagged by their
md5sums. When running the docker scripts these docker images will, if not in the local registry, will first be attempted to be pulled from dockerhub and only then fallback to be built locally. This allows the dockerfiles to be
modified in existing patches and be run in existing CI as-is. Docker scripts timeout after one hour. virtualenv-clone is used, re-using the python versioned venvs in the image saves time over creating new ones each run. The inner-spliting of docker containers has been removed. It added a lot of complexity, for the most part duplicating the splitting concept, for little performance gain.
Ant target 'generate-unified-test-report' added, used for aggregating test reports and printing a summary.
patch by Mick Semb Wever; reviewed by Brandon Williams, Josh McKenzie, Maxim Muzafarov, Stefan Miklosovic for CASSANDRA-18133
f5df4b219e063cb24b9cc0c22b6e614506b8d903 | Author: Mick Semb Wever <mck@apache.org>
| 2022-12-18 01:16:16-08:00
Move build and test scripts in-tree, under .build/
See .build/README.md .Build and test scripts cover all CI activities in an CI agnostic manner. Scripts are found in non-docker and dockerised variants.
The non-docker scripts are found first under .build/ .These interact directly with ant, providing additional checks and environment setup. It is intended that what can be pushed down into the base ant build layer should be. The
debian and redhat build scripts are hidden under .build/docker because they are generally not usuable outside of their corresponding linux dists, and we don't want to encourage anything to the contrary. Bring the artifact/deb/rpm
build scripts (and associated docker images) from cassandra-builds repo to the .build directory. These packaging script for debian and redhat are now separated from the artifacts scripts. An additional build script check-code.sh
has been added that is solely responsible for all linter and code checks (includes owasp dependency checker). Only JDK11 and JDK17 are supported (as JDK8 is soon to be dropped). Scripts do not clean (or realclean) so that
scripts can be better pipelined, but `ant jar` was required to be added to circleci and ci-cassandra.a.o cqlsh-tests. Scripts can define a custom BUILD_DIR (build.dir) which can permit running parrallel builds off the same source
(though not all tests support this, or their support for it has atrophied). All build and test artifacts, results, and logs are found under build/ (or the BUILD_DIR). The build local venv and .ccm directories are now also
created under build (or BUILD_DIR). The test venv, logs and results are wiped each run. Use a separate mktemp directory each run, under /tmp (respect /tmp responsibility, and python fails when tmpdir is on a docker volume).
Don't set CASSANDRA_HOME when running python dtests (and fail-fast if `ant artifacts` was used to build instead of `ant jar`).
The docker scripts are found lower down under .build/docker/ .These scripts re-used the non-docker scripts inside containers. The docker images are versioned controlled in the same directory as dockerfiles, and tagged by their
md5sums. When running the docker scripts these docker images will, if not in the local registry, will first be attempted to be pulled from dockerhub and only then fallback to be built locally. This allows the dockerfiles to be
modified in existing patches and be run in existing CI as-is. Docker scripts timeout after one hour. virtualenv-clone is used, re-using the python versioned venvs in the image saves time over creating new ones each run. The inner-spliting of docker containers has been removed. It added a lot of complexity, for the most part duplicating the splitting concept, for little performance gain.
Ant target 'generate-unified-test-report' added, used for aggregating test reports and printing a summary.
patch by Mick Semb Wever; reviewed by Brandon Williams, Josh McKenzie, Maxim Muzafarov, Stefan Miklosovic for CASSANDRA-18133
2049e854f5aec3dac39c45a29f4368db82b72cfb | Author: Mick Semb Wever <mck@apache.org>
| 2022-12-05 15:13:02+01:00
Update jenkins groovy dsl, and release scripts, to use in-tree scripts from CASSANDRA-18133
patch by Mick Semb Wever; reviewed byJosh McKenzie, Maxim Muzafarov for CASSANDRA-18665
7e205252a001b9316efe98da329d26e3b62c1df9 | Author: Mick Semb Wever <mck@apache.org>
| 2022-12-05 15:13:02+01:00
Add JDK17 support, excluding trunk's (5.0) unit and jvm-dtest jobs which still have test failures
- always pull images to be on latest
- cqlshlib-test can no longer share a workspace
- unset JAVAN_HOME env variables
- don't dtest-jar build older versions when they don't support jdk11 (they won't be included anyway)
- warn and continue on git clean failures
- update finish_release.sh post-instructions to include having to update cassandra-dtest/upgrade_tests/upgrade_manifest.py
patch by Mick Semb Wever; reviewed by Brandon Williams, Ekaterina Dimitrova for CASSANDRA-17869
16a025c86ede72e04a6cf32d2cc1d989c2b74e02 | Author: Mick Semb Wever <mck@apache.org>
| 2022-11-10 08:58:59+01:00
The cython variable from the jenkins axis must be passed through into the docker container, and absolute paths used for the workspace
patch by Mick Semb Wever; reviewed by Berenguer Blasi for CASSANDRA-18028
7823fdc014a3029cf72a8f5804b2f764493619b4 | Author: Mick Semb Wever <mck@apache.org>
| 2022-11-07 12:58:53+01:00
Increase timeouts to apt downloading and add retries to docker building to better handle slow internet connections
c100d34a1a1d497eee85ca10c5cc1e43eb4871c4 | Author: Aleksey Yeschenko <aleksey@apache.org>
| 2022-11-02 17:30:57+00:00
Restore streaming_keep_alive_period functionality on the netty control streaming channel
patch by Aleksey Yeschenko, Mick Semb Wever; reviewed by Mick Semb Wever, Berenguer Blasi for CASSANDRA-17768
Co-authored-by: Aleksey Yeschenko <aleksey@apache.org
Co-authored-by: Mick Semb Wever <mck@apache.org>
7572725defd4d5bba12097046b8338a955d8d032 | Author: Derek Chen-Becker <dchenbec@amazon.com>
| 2022-10-26 14:54:05-06:00
[CASSANDRA-17950] Enable dtest-offheap in CircleCI
The dtest-offheap test was only added to the Jenkins configuration, so
this commit adds it to the CircleCI build for parity.
Patch by Derek Chen-Becker; reviewed by Ekaterina Dimitrova, Derek Chen-Becker, Michael Semb Wever, and Andres de la Pena for CASSANDRA-17950
Co-authored-by: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
Co-authored-by: Derek Chen-Becker <dchenbec@amazon.com>
6247c9d966d7e3886fef0c7486013578407b37e4 | Author: David Capwell <dcapwell@apache.org>
| 2022-06-06 13:42:00-07:00
jvm-dtest upgrade tests run all supported pairs of upgrades between from/to but does not actually test all patches from/to
patch by David Capwell; reviewed by Jon Meredith, Michael Semb Wever for CASSANDRA-17656
2eac2590bfe85b76c5fc1ea7c818082e124f5ed5 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2022-05-31 11:01:44-04:00
Revert removal of withBufferSizeInMB(int size) to CQLSSTableWriter.Builder and deprecate it in favor of withBufferSizeIniB(int size);update the docs
patch by Ekaterina Dimitrova; reviewed by Michael Semb Wever for CASSANDRA-17675
136c8c0f65cc8f2db87bb683e6eaceb05016f00e | Author: Mick Semb Wever <mck@apache.org>
| 2022-05-26 14:06:47+02:00
In jenkins retry each stage build in the pipeline
attempts to alleviate the false-negatives from CI infrastructure faults (disks, network, etc)
patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-17664
31a735b2ec74124a32d97a9207e229dda65331db | Author: Mick Semb Wever <mck@apache.org>
| 2022-05-20 21:38:10+02:00
SHAs printed need to be consistent (abbreviated are vary in length), see jenkins-dsl/print-shas.sh
patch by Mick Semb Wever; reviewed by Berenguer Blasi
0bcc3549920aa218750dabdceb734430a3942882 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2022-05-07 20:11:12-04:00
Use :latest tag for our test images in CircleCI config files
patch by Ekaterina Dimitrova; reviewed by Michael Semb Wever for CASSANDRA-17429
2480a7e7ee64791acec6add38e134753b95236fd | Author: Mick Semb Wever <mck@apache.org>
| 2022-05-02 17:17:46+02:00
Update trunk to version 4.2
Update jvm-dtest supported upgrade paths.
Update circeci to build 4.1 dtest jar
patch by Mick Semb Wever; reviewed by Ekaterina Dimitrova for CASSANDRA-17589
d2d15cee9c417e502e29a1a92ded6efa31b92707 | Author: Mick Semb Wever <mck@apache.org>
| 2022-05-02 15:59:41+02:00
Update trunk to version 4.2
Ddocker testing images to include cassandra-4.2 (delete unused ubuntu1910).
Build dtest jar for 4.2 too.
Add 4.1 ci-cassandra.a.o jobs.
Increase git's http.postBuffer (common CI problem).
patch by Mick Semb Wever; reviewed by Ekaterina Dimitrova for CASSANDRA-17589
5207a25a8eeb994419aa3746aeb55fdd62a0708d | Author: Mick Semb Wever <mck@apache.org>
| 2022-04-17 22:59:15+02:00
When building deb and rpm packages (in docker containers) re-use the host's local maven repository
patch by Mick Semb Wever; reviewed by Martin Grigorov for INFRA-23147
4d11d17fe73872b4cd4ddf58cfddc745e0d528c9 | Author: Mick Semb Wever <mck@apache.org>
| 2022-03-25 12:41:12+01:00
In cassandra-test.sh, list the tests in alphabetical sorting so splits are consistent
The order `find` prints the list can change over filesystems and over time.
patch by Mick Semb Wever; reviewed by Brandon Williams
d0c68e02fa235fd2218a40684a10c9573fcb001c | Author: Mick Semb Wever <mck@apache.org>
| 2022-03-19 20:55:12+01:00
Limit GH pull request to rebases
patch by Mick Semb Wever; reviewed by Benjamin Lerer, Berenguer Blasi, Brandon Williams, Ekaterina Dimitrova, Stefan Miklosovic for CASSANDRA-17419
cd6533401282e0455f87ba4d4a58bfec18fde4dc | Author: maedhroz <calebrackliffe@gmail.com>
| 2022-03-14 13:35:11-05:00
Update SUPPORTED_UPGRADE_PATHS to include 3.0 and 3.x to 4.1 paths and remove obsolete tests
patch by Caleb Rackliffe; reviewed by Mick Semb Wever for CASSANDRA-17362
302c6fcf59c5fa9fcd475b2c811ad57ae7c45f49 | Author: Caleb Rackliffe <calebrackliffe@gmail.com>
| 2022-03-10 17:12:47-06:00
Update SUPPORTED_UPGRADE_PATHS to include 3.0 and 3.x to 4.1 paths and remove obsolete tests
patch by Caleb Rackliffe; reviewed by Mick Semb Wever for CASSANDRA-17362
9f56bf4ca7fdb61ad09e5f2ad09b87cd01e0716b | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2022-02-05 17:51:32-05:00
Remove old Duration class in favor of DurationSpec class
patch by Ekaterina Dimitrova; reviewed by Caleb Rackliffe, David Capwell, Michael Semb Wever and Benjamin Lerer for CASSANDRA-15234
c51a7c66fc21ca2da08b89ae5f9b4817ee4d8c23 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2022-02-05 17:15:18-05:00
Bulk change of units around the code to support the move to the new configuration framework
patch by Ekaterina Dimitrova; reviewed by Caleb Rackliffe, David Capwell, Michael Semb Wever and Benjamin Lerer for CASSANDRA-15234
230fe8e64722ac02dbf8cdafb7d4fef120726dd7 | Author: Abe Ratnofsky <abe@aber.io>
| 2022-02-04 11:15:42-08:00
Include Git SHA in --verbose flag for nodetool version
Patch by Abe Ratnofsky; review by Brandon Williams, Caleb Rackliffe, Michael Semb Wever and Stefan Miklosovic for CASSANDRA-17753
6d5203615f7a9670cb1698b74123666bc25ba471 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2022-02-04 00:25:14-05:00
Transfer parameters to the newly introduced configuration framework (7)
patch by Ekaterina Dimitrova; reviewed by Caleb Rackliffe, David Capwell, Michael Semb Wever and Benjamin Lerer for CASSANDRA-15234
23138252f20891c26a3692664c6affaf99e86541 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2022-02-03 23:49:50-05:00
Transfer parameters to the newly introduced configuration framework (6)
patch by Ekaterina Dimitrova; reviewed by Caleb Rackliffe, David Capwell, Michael Semb Wever and Benjamin Lerer for CASSANDRA-15234
1315d0c96f4625a76296f58d431f97669e5178c2 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2022-02-03 22:28:41-05:00
Transfer parameters to the newly introduced configuration framework (5)
patch by Ekaterina Dimitrova; reviewed by Caleb Rackliffe, David Capwell, Michael Semb Wever and Benjamin Lerer for CASSANDRA-15234
ed48f3c017c5e572a523890bcd5b7c798d7eb358 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2022-02-03 16:43:36-05:00
Transfer parameters to the newly introduced configuration framework (4)
patch by Ekaterina Dimitrova; reviewed by Caleb Rackliffe, David Capwell, Michael Semb Wever and Benjamin Lerer for CASSANDRA-15234
755fd9446b084e659e98bd7336b9e910c2e12577 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2022-02-03 14:39:48-05:00
Transfer parameters to the newly introduced configuration framework (3)
patch by Ekaterina Dimitrova; reviewed by Caleb Rackliffe, David Capwell, Michael Semb Wever and Benjamin Lerer for CASSANDRA-15234
d85f7f7c2dd4b9bbdb44bc96235e6a8bc3ff3967 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2022-02-03 00:19:28-05:00
Transfer parameters to the newly introduced configuration framework (2)
patch by Ekaterina Dimitrova; reviewed by Caleb Rackliffe, David Capwell, Michael Semb Wever and Benjamin Lerer for CASSANDRA-15234
b9e2ab75f8f6dedd45c6ad7a83b3160149869262 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2022-02-02 12:47:41-05:00
Extend DurationSpec and DataStorageSpec for smallest unit and transfer denylist parameters to the new framework
patch by Ekaterina Dimitrova; reviewed by Caleb Rackliffe, David Capwell, Michael Semb Wever and Benjamin Lerer for CASSANDRA-15234
a3258d66bcc9f946304c19d59e75d2721126303e | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2022-02-01 17:14:17-05:00
Transfer parameters to the newly introduced configuration framework (1)
patch by Ekaterina Dimitrova; reviewed by Caleb Rackliffe, David Capwell, Michael Semb Wever and Benjamin Lerer for CASSANDRA-15234
5bb4bab12f8edfef95ed13cbabf8c0f377986065 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2022-01-31 21:51:49-05:00
DataRate parameters transition to the new framework
Fix the DB descriptorRefTest which failed on the previous commit
patch by Ekaterina Dimitrova; reviewed by Caleb Rackliffe, David Capwell, Michael Semb Wever and Benjamin Lerer for CASSANDRA-15234
db9f7a67ec4b03413c10034956e2cf18739ca4b1 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2021-12-14 23:00:56-05:00
Add new custom types and unit tests for configuration
patch by Ekaterina Dimitrova; reviewed by Caleb Rackliffe, David Capwell, Michael Semb Wever and Benjamin Lerer for CASSANDRA-15234
3935906a685640b2f6a2058b38fdf45d917edfc9 | Author: Ekaterina Dimitrova <ekaterina.dimitrova@datastax.com>
| 2021-11-19 17:42:29-05:00
Fixes needed to support the new configuration framework and change of parameters
patch by Ekaterina Dimitrova, reviewed by Caleb Rackliffe, David Capwell, Michael Semb Wever and Benjamin Lerer for CASSANDRA-15234
b4f1c6d250991fc27c5f87a2dc0fd81e7ad0d272 | Author: Caleb Rackliffe <calebrackliffe@gmail.com>
| 2020-05-28 14:26:25-06:00
Safer handling of out-of-range tokens
patch by Caleb Rackliffe; reviewed by Mick Semb Wever for CASSANDRA-13704
Co-authored-by: Sam Tunnicliffe <sam@beobal.com>
Co-authored-by: Caleb Rackliffe <calebrackliffe@gmail.com>
Co-authored-by: Mick Semb Wever <mck@apache.org>
Co-authored-by: Ariel Weisberg <aweisberg@apple.com>