summaryrefslogtreecommitdiffstats
path: root/tools/performance/cloud
AgeCommit message (Collapse)AuthorFilesLines
2020-06-04Refactor performance scriptsTomasz Wrobel8-123/+254
-change scripts to use deployment instead of pod -add function for instant,inverval mode -add config files -remove unused variable from test.properties Issue-ID: DCAEGEN2-1576 Change-Id: Ice889f7e8e1dd2d787c7b59a9701669a93a7cfb1 Signed-off-by: Tomasz Wrobel <tomasz.wrobel@nokia.com>
2020-06-04Adjust performance tests prometheus and grafana to newer producerRemigiusz Janeczek7-1057/+2450
- Add prometheus scrape job to get metrics from each producer pod behind a service - Increase prometheus and grafana resolution - Add grafana dashboard for producer metrics Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Issue-ID: DCAEGEN2-1576 Change-Id: I584c5c24e1a54da42da9be35cc5fc028eb72b0c6
2020-05-29Merge "Refactor deployment of performance tests"Kornel Janiak2-82/+86
2020-05-29Refactor deployment of performance testsTomasz Wrobel2-82/+86
-Change producer pod to producer deployment -Add service for producer Issue-ID: DCAEGEN2-1576 Signed-off-by: Tomasz Wrobel <tomasz.wrobel@nokia.com> Change-Id: I29eebedf078abe76d60b4cf2555119ee3736d9a3
2020-05-18Merge "Update metric for message queue"Kornel Janiak1-1/+1
2020-05-08Update image pathsmharazin3-5/+6
Issue-ID: DCAEGEN2-1576 Signed-off-by: Mateusz Harazin <mateusz.harazin@nokia.com> Change-Id: I23ac180442889fad2665ba7413aa71cad90fc313
2020-04-30Update metric for message queueTomasz Wrobel1-1/+1
Include dropped messages in queue calculation Issue-ID: DCAEGEN2-1576 Signed-off-by: Tomasz Wrobel <tomasz.wrobel@nokia.com> Change-Id: Id4aa32dbe9af5d0a8ca7a487c53a42ced6e7d933
2020-04-23Add metric for total latency without routingRemigiusz Janeczek3-517/+661
Add metric for time between Producer and HV-VES output without sending to Kafka Refactor metrics test Add new latencies and individual cores usage to Grafana Issue-ID: DCAEGEN2-1576 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I6112db76be1c7108c18336b50f9f12d5ce62c24a
2020-04-23Add script for loading prometheus snapshots, improve grafanaRemigiusz Janeczek19-2085/+2358
1. Add scripts for loading prometheus snapshots locally 2. Improve Grafana dashboards for performance tests 3. Improve Grafana dashboards management (now there's one configmap for all dashboards and to add new dashboard only needed change is adding new json file in grafana/dashboards directory) 4. Add prometheus job for scraping node metrics and add deployment yaml for node exporter Issue-ID: DCAEGEN2-1576 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I8870fd3291711b5dc09b76a7bf86ac4d13725237
2020-04-15Merge "Get raw result of stress tests from prometheus"6.0.0-ONAPfrankfurtPiotr Wielebski2-0/+35
2020-04-14Get raw result of stress tests from prometheusmharazin2-0/+35
Issue-ID: DCAEGEN2-1576 Signed-off-by: Mateusz Harazin <mateusz.harazin@nokia.com> Change-Id: I7c18c81f990bd7828e6507d1a7ac6ffc50d0d60e
2020-04-08Add new metrics for performance testsRemigiusz Janeczek6-3/+1385
Add metrics considering: -Kafka -Message producers -Overall k8s nodes statistics Issue-ID: DCAEGEN2-1576 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I8523099834a2652df359d6a50b19a86d6f417adc
2020-04-07Update performance test cloud scriptsRemigiusz Janeczek4-36/+46
Update kafka commands Use new path for test certs as the previous is already utilized by other certs. Update docker images repository. Change consul request to be performed internally for cases when consul is not available externally. Issue-ID: DCAEGEN2-1576 Change-Id: I7ca38739875b5f0ad7e4eac600508602eea4adb6 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
2019-11-15Improve performance test environment rebooting scriptRemigiusz Janeczek1-24/+57
Issue-ID: DCAEGEN2-1883 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I841ee6326467d495dc40686bca0f22800cb4ac61
2019-11-04Merge "Add graph for processing time without routing"Piotr Wielebski1-1/+117
2019-11-04Merge "Reorganize deletion of completed producers"Piotr Wielebski1-11/+14
2019-11-04Add graph for processing time without routingRemigiusz Janeczek1-1/+117
Issue-ID: DCAEGEN2-1858 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I9a3069e639bd723c9ea02b98de412a41cfb4eb5d
2019-11-04Merge "Add option to set kafka retention time for load tests"Piotr Wielebski1-3/+18
2019-11-04Merge "Add test environment rebooting script"Piotr Wielebski2-2/+118
2019-11-04Add option to set kafka retention time for load testsRemigiusz Janeczek1-3/+18
Issue-ID: DCAEGEN2-1783 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: Ib78d018864d9cc220b1f23ab2f3f4340c17cef78
2019-11-04Add test environment rebooting scriptRemigiusz Janeczek2-2/+118
Issue-ID: DCAEGEN2-1883 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I4a3c801d4cc20d1db55f491e2f49133da36da05e
2019-10-24Reorganize deletion of completed producerskjaniak1-11/+14
Load performance test enhancement Change-Id: I8b87ff7fdaaa17dd69cd5136726faa45f497dc71 Issue-ID: DCAEGEN2-1881 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-10-24Cleanup in cloud scriptkjaniak1-8/+10
Change-Id: I8919bbb8403d8d008a678c2310175232eae8df1d Issue-ID: DCAEGEN2-1783 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-10-24Merge "Add load test case to performance script"Piotr Wielebski1-14/+71
2019-10-24Add load test case to performance scriptkjaniak1-14/+71
This is done for cloud script only Change-Id: If66225ab56d04c4f1a9037eca58f89b0c0be1c1e Issue-ID: DCAEGEN2-1881 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-10-23Fix performance test issuesRemigiusz Janeczek2-1/+1
Issue-ID: DCAEGEN2-1783 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I367d109fc5903cd3fd6dbfeeda77d30d780a8a09
2019-10-21Merge "Add setting up consul configuration to cloud performance test shell ↵Piotr Wielebski2-0/+67
scripts"
2019-10-18Add setting up consul configuration to cloud performance test shell scriptsRemigiusz Janeczek2-0/+67
Issue-ID: DCAEGEN2-1783 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I8b1b2c68578e52898af0596a039ecebf764560a0
2019-10-18Improve grafana dashboardsRemigiusz Janeczek3-155/+96
Issue-ID: DCAEGEN2-1858 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I6ce040a7e9ad4e70c2f8c1139de66b1145cabe5b
2019-10-17Merge "Verify system_cpu_usage metric and fix memory usage per pod in cloud ↵Piotr Wielebski1-220/+280
deployment"
2019-10-17Verify system_cpu_usage metric and fix memory usage per pod in cloud deploymentpawel1-220/+280
Issue-ID: DCAEGEN2-1855 Signed-off-by: pawel <pawel.kasperkiewicz@nokia.com> Change-Id: I99ffdf23515ebe9c070abc5b1993db0cebaedf80
2019-10-17Reorganize of Performance tests dashboardkjaniak1-70/+72
Change-Id: I4fc7c90034c5c060d50c740eb567c992bf29fe74 Issue-ID: DCAEGEN2-1783 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-10-16Move certificates directory creation to dockerfileRemigiusz Janeczek1-2/+0
Issue-ID: DCAEGEN2-1783 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: If4d9c0dab255ce4f2024f06da40c724dd98d7e5f
2019-10-15Fix of hv-ves consumer image versionkjaniak1-2/+2
Changed image version of consumer in performance tests Change-Id: If83a334defc301ffb89e6596f5f23acac25b0216 Issue-ID: DCAEGEN2-1783 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-10-13Merge "Fix of configmap issue"Tony Hansen1-3/+6
2019-10-11Fix of configmap issuekjaniak1-3/+6
Change-Id: Ia24f86ac0a516dea06b2e4d6c2d0479005864493 Issue-ID: DCAEGEN2-1783 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-10-11Add SSL support to cloud performance testskjaniak5-6/+63
Change-Id: Ie0a6341592efe3bfe3e386c01026600d16110cef Signed-off-by: kjaniak <kornel.janiak@nokia.com> Issue-ID: DCAEGEN2-1827
2019-10-08Add graphs for performance monitoringkjaniak3-93/+361
Performance tests need graphs representing: total, message queue on HV-VES, offset per kafka topic partition, incoming data rate. Added deletion of producers at test end. Gauges for offsets turned to Range vector (distinguishable based on tag). Since Producer is to fast it was reconfigured to send messages with 1 ms interval. Change-Id: I09fc1edbcd824294d0bb89acc2ea2306a6df00ca Issue-ID: DCAEGEN2-1807 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-10-03Setup Grafana on Cloud (hv-ves)pawel7-0/+2089
Issue-ID: DCAEGEN2-1784 Signed-off-by: pawel <pawel.kasperkiewicz@nokia.com> Change-Id: I87159f360854dccb56e9393bfbe87f66f71dcb6e
2019-09-26Add partition offset metric to each topic partitionkjaniak2-2/+2
Before this commit offset consumer was able to fetch offset just from one partition. This commit solve this. Change-Id: I2c2c300219e43ab422b237094ad775ca8795169e Issue-ID: DCAEGEN2-1783 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-09-06Add Prometheus deployment for HV-VES performance tests - cloudkjaniak6-7/+209
Script for cloud is updated with proper prometheus config and deployment. Change-Id: Icf2527e76bc2028807653313c8ec978d779c6ec9 Issue-ID: DCAEGEN2-1692 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-07-19Fix of hv-ves dns configurationkjaniak1-5/+1
Change-Id: I2f859c5a683fb9de0efd2ba93dcd853d8f70df1d Issue-ID: DCAEGEN2-1664 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-07-17Adding script for Performance tests of HV-VES on cloudkjaniak4-21/+162
Change-Id: If71b0e8b04ce23a5daafef632788667ccd50c1a1 Issue-ID: DCAEGEN2-1664 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-07-05Add performance test producer deployment yamlJakub Dudycz3-0/+187
- create cloud performance test directory structure - move consumer deployment file to "tools/performence/cloud" directory Change-Id: Ia5c6d8ed15a2188ff9306cf788052f432dae1e33 Signed-off-by: Jakub Dudycz <jakub.dudycz@nokia.com> Issue-ID: DCAEGEN2-1652