summaryrefslogtreecommitdiffstats
path: root/k6-tests/ncmp/ncmp-kpi.js
AgeCommit message (Collapse)AuthorFilesLines
2024-08-30[k6] Report failure rate for all tests in a single plotdanielhanrahan1-8/+1
Instead of separate plots of test failures for each test case, we have one single plot showing failures. Issue-ID: CPS-2347 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ie79b75c34903a7df2037474b3536d4867c1a61e0
2024-08-30[k6] Fix k6 tests after DMI stub changesdanielhanrahan1-5/+5
A change to DMI stub has broken k6 module search due to module rename and increased registration time. - increase setupTimeout by 2 minutes to factor in DMI startup delay - module search uses module common to all module set tags - only record times for searches returning number of CM-handles Issue-ID: CPS-2353 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I9067dc73015cfb475cdce1e7a3cc2d5401449caf
2024-08-27[k6] Exclude timings when error occurdanielhanrahan1-26/+35
If an error occurs during k6 test, e.g. tcp connection refused, the timing of failed response is included in the average response time. This can lead to incorrect plots when errors occur, e.g. operations appear to be faster when really the operations are failing. - use custom Trend metrics for all measurements - only log results when operations return expected response codes Issue-ID: CPS-2345 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Iab1db5e5ca9530f33da239187348cabcd0605648
2024-08-26Plot request failures for each k6 testhalil.cakal1-5/+35
- add request failures to plot for each tests - simplify setup and teardown function Issue-ID: CPS-2347 Change-Id: I81226518af7bda12b0489ec46de08e27c96cc16d Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-08-16[k6] Remove incorrect passthrough ratesdanielhanrahan1-9/+5
Reported rates for passthrough operations is incorrectly reported, due to it being averaged over whole test time including setup and teardown. It was agreed to simply not report rates, and only report NCMP overhead. - remove http request rates for passthrough operations - change VUs from passthrough read so that there are 10 total Issue-ID: CPS-2264 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ida498955e69dffb332d6efeb8a8d73343565f9a1
2024-08-12K6 performance test for Alternate Id Readseanbeirne1-1/+16
Issue-Id: CPS-2279 Change-Id: Iade53a85afb183c0df259c5e7fc12fa0f6986218 Signed-off-by: seanbeirne <sean.beirne@est.tech>
2024-07-31Merge "Add k6 for legacy async batch passthrough read operation"Daniel Hanrahan1-3/+50
2024-07-31Add k6 for legacy async batch passthrough read operationhalil.cakal1-3/+50
- add kafka support to k6 codebase - add two new tests: data operation batch passthrough read and data operation async batch read (from kafka) - calculate the events/second via Trend - add kafka ui support to docker-compose Note: Before this commit being merged, the k6 executable should have been compiled with the kafka extension of xk6-kafka Issue-ID: CPS-2268 Change-Id: Ib7777b7bc9f15b210ea36d3541cba0e0c943f883 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-07-25[k6] Fix response code check for passthrough write testdanielhanrahan1-1/+1
The POST operation returns 201, not 200. This causes checks to fail when running k6 manually. Issue-ID: CPS-2267 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I3c0e771b89aa09e41c9dbdf1c532599e1ab5440d
2024-07-18[k6] Measure NCMP overhead for passthrough operationsdanielhanrahan1-4/+15
Measure NCMP overhead by subtracting DMI delay from request duration. Issue-ID: CPS-2269 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ieb4758e9f7cab119da4c28e4a3febfa1361b2613
2024-07-16Report throughput for passthrough read operationhalil.cakal1-2/+1
- change threshold from avg duration to req per second - the delay for dmi has been hanlded in seprate commit in dmi repository - add delays through docker-compose env variables Issue-ID:CPS-2285 Change-Id: I35978b21c208fdb4209b1610160dc5545ee22965 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-07-12Add passthrough write (CUD) operations to k6halil.cakal1-1/+13
- the delay for dmi has been hanlded in seprate commit - for simplicity only the POST request is considered Issue-ID: CPS-2267 Change-Id: I62ede04dd8e2744fc723566742396df31c42ea5d Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-07-05[k6] Measure CM-handle (de)registration in CM-handles/secdanielhanrahan1-0/+99
As per characteristics requirements document: - measure registration in CM-handles/second - measure deregistration in CM-handles/second - summary table includes test case number, description, units of measurement, actual value and limit. Issue-ID: CPS-2269 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I838004da1c230ab722f49c2adacf34e730d7ac79