aboutsummaryrefslogtreecommitdiffstats
path: root/k6-tests
AgeCommit message (Collapse)AuthorFilesLines
2024-08-16[k6] Remove incorrect passthrough ratesdanielhanrahan2-14/+8
Reported rates for passthrough operations is incorrectly reported, due to it being averaged over whole test time including setup and teardown. It was agreed to simply not report rates, and only report NCMP overhead. - remove http request rates for passthrough operations - change VUs from passthrough read so that there are 10 total Issue-ID: CPS-2264 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ida498955e69dffb332d6efeb8a8d73343565f9a1
2024-08-15Fix syntax error on k6 testdanielhanrahan1-1/+1
Issue-ID: CPS-2357 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ibbd32282608ff707c8030d43df3cf85043242218
2024-08-14Add moduleSetTag on k6 testemaclee2-2/+4
Issue-ID: CPS-2357 Change-Id: I21b980b1e36988d3b5daf07e4f6a14fe4309cd20 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
2024-08-12K6 performance test for Alternate Id Readseanbeirne4-1/+28
Issue-Id: CPS-2279 Change-Id: Iade53a85afb183c0df259c5e7fc12fa0f6986218 Signed-off-by: seanbeirne <sean.beirne@est.tech>
2024-07-31Merge "Add k6 for legacy async batch passthrough read operation"Daniel Hanrahan4-6/+79
2024-07-31Add k6 for legacy async batch passthrough read operationhalil.cakal4-6/+79
- add kafka support to k6 codebase - add two new tests: data operation batch passthrough read and data operation async batch read (from kafka) - calculate the events/second via Trend - add kafka ui support to docker-compose Note: Before this commit being merged, the k6 executable should have been compiled with the kafka extension of xk6-kafka Issue-ID: CPS-2268 Change-Id: Ib7777b7bc9f15b210ea36d3541cba0e0c943f883 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-07-25[k6] Fix response code check for passthrough write testdanielhanrahan1-1/+1
The POST operation returns 201, not 200. This causes checks to fail when running k6 manually. Issue-ID: CPS-2267 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I3c0e771b89aa09e41c9dbdf1c532599e1ab5440d
2024-07-18[k6] Measure NCMP overhead for passthrough operationsdanielhanrahan2-13/+30
Measure NCMP overhead by subtracting DMI delay from request duration. Issue-ID: CPS-2269 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ieb4758e9f7cab119da4c28e4a3febfa1361b2613
2024-07-16Report throughput for passthrough read operationhalil.cakal2-3/+2
- change threshold from avg duration to req per second - the delay for dmi has been hanlded in seprate commit in dmi repository - add delays through docker-compose env variables Issue-ID:CPS-2285 Change-Id: I35978b21c208fdb4209b1610160dc5545ee22965 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-07-12Add passthrough write (CUD) operations to k6halil.cakal4-3/+26
- the delay for dmi has been hanlded in seprate commit - for simplicity only the POST request is considered Issue-ID: CPS-2267 Change-Id: I62ede04dd8e2744fc723566742396df31c42ea5d Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-07-09Merge "Setup automated tests with two replicas of cps-and-ncmp"Daniel Hanrahan1-2/+10
2024-07-05[k6] Measure CM-handle (de)registration in CM-handles/secdanielhanrahan10-231/+130
As per characteristics requirements document: - measure registration in CM-handles/second - measure deregistration in CM-handles/second - summary table includes test case number, description, units of measurement, actual value and limit. Issue-ID: CPS-2269 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I838004da1c230ab722f49c2adacf34e730d7ac79
2024-07-01Setup automated tests with two replicas of cps-and-ncmphalil.cakal1-2/+10
- this change for two test suits: CSIT and K6 - increase cps-and-ncmp replicas to 2 - introduce nginx as load-balancer - set proxies inside nginx for the cps-and-ncmp URI paths - upgrade hazelcast-spring to 5.3.7 Issue-ID: CPS-2038 Change-Id: If1b6c1e1218af16b24cc061507ea9b25d277d143 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-06-24Clean up the k6 test suitehalil.cakal10-324/+9
- Remove the tests that are not in the Characteristics - Set .625 seconds/operation for cm handle id search with module filter - Set 13 seconds/operation for cm handle search with module filter Issue-ID: CPS-2286 Change-Id: I88d5773abadb29ce46914029332384ae8e55e032 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-06-14[k6] Add JVM warmup phase (#2)danielhanrahan4-9/+14
To account for JVM warmup effect, the k6 test suite is run twice: initially, the whole test suite is run without recording results. - Added environment variables to allow setting total CM-handles and batch size for registration. By reducing total CM-handles during warm-up, many more operations will be run. Issue-ID: CPS-2264 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ib1d1e76d31719d788a3e026797faa0a425b320a2
2024-06-14[k6] Refactoring k6 tests (#1)danielhanrahan15-117/+174
This commit moves all common request logic into a common folder. It is needed to avoid duplication before adding JVM warmup phase. - move registration-related code into common folder - move passthrough operations into common folder Issue-ID: CPS-2208 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ia9ebf61d21044b43063bde153f9c526e67d607c8
2024-06-06[k6] Refactor k6 tests for CM handle searchesdanielhanrahan8-66/+46
A cleanup of the k6 tests to avoid code duplication Issue-ID: CPS-2208 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: If1e58ee87300cd28ed72b365d9a86e2709dc6c13
2024-05-28Adjust K6 thresholdsdanielhanrahan11-28/+28
- Adjust timings based on previous runs. - Reduce from 5 to 4 parallel clients for CM handle searches to avoid OutOfMemoryErrors. Issue-ID: CPS-2208 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I339cc3df84b2295bb11371ab73b4948f43615c15
2024-05-27Print summary report for K6 testshalil.cakal15-80/+183
- add a generic template to print summary of k6 test results - remove container logs since its around 50 mb Issue-ID: CPS-2215 Change-Id: I8971fc30b9dc8be2ed16eda6755d17a91f608b48 Signed-off-by: halil.cakal <halil.cakal@est.tech> Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-05-22Add k6 performance tests for NCMPdanielhanrahan18-0/+781
This commit adds K6 tests for NCMP functionalities: - Registration of 20000 CM-handles - Synchronous single CM-handle passthrough read operation - CM-handle and ID searches for no filter, module, and public property - De-registration of 20000 CM-handles - A mixed load test Also includes a README and shell scripts to run all tests. Issue-ID: CPS-2199 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ia2e59674057ed28f5f9ceed9465133f7c0ce8318