summaryrefslogtreecommitdiffstats
path: root/tools
AgeCommit message (Collapse)AuthorFilesLines
2020-04-23Add metric for total latency without routingRemigiusz Janeczek3-517/+661
Add metric for time between Producer and HV-VES output without sending to Kafka Refactor metrics test Add new latencies and individual cores usage to Grafana Issue-ID: DCAEGEN2-1576 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I6112db76be1c7108c18336b50f9f12d5ce62c24a
2020-04-23Add script for loading prometheus snapshots, improve grafanaRemigiusz Janeczek19-2085/+2358
1. Add scripts for loading prometheus snapshots locally 2. Improve Grafana dashboards for performance tests 3. Improve Grafana dashboards management (now there's one configmap for all dashboards and to add new dashboard only needed change is adding new json file in grafana/dashboards directory) 4. Add prometheus job for scraping node metrics and add deployment yaml for node exporter Issue-ID: DCAEGEN2-1576 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I8870fd3291711b5dc09b76a7bf86ac4d13725237
2020-04-15Merge "Get raw result of stress tests from prometheus"6.0.0-ONAPfrankfurtPiotr Wielebski3-0/+36
2020-04-14Get raw result of stress tests from prometheusmharazin3-0/+36
Issue-ID: DCAEGEN2-1576 Signed-off-by: Mateusz Harazin <mateusz.harazin@nokia.com> Change-Id: I7c18c81f990bd7828e6507d1a7ac6ffc50d0d60e
2020-04-08Add new metrics for performance testsRemigiusz Janeczek6-3/+1385
Add metrics considering: -Kafka -Message producers -Overall k8s nodes statistics Issue-ID: DCAEGEN2-1576 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I8523099834a2652df359d6a50b19a86d6f417adc
2020-04-07Update performance test cloud scriptsRemigiusz Janeczek5-37/+47
Update kafka commands Use new path for test certs as the previous is already utilized by other certs. Update docker images repository. Change consul request to be performed internally for cases when consul is not available externally. Issue-ID: DCAEGEN2-1576 Change-Id: I7ca38739875b5f0ad7e4eac600508602eea4adb6 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
2019-11-15Merge "Improve performance test environment rebooting script"Tony Hansen1-24/+57
2019-11-15Improve performance test environment rebooting scriptRemigiusz Janeczek1-24/+57
Issue-ID: DCAEGEN2-1883 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I841ee6326467d495dc40686bca0f22800cb4ac61
2019-11-12Merge "Revert - Fix memory usage per pod table"Tony Hansen3-26/+1
2019-11-04Merge "Add graph for processing time without routing"Piotr Wielebski1-1/+117
2019-11-04Merge "Reorganize deletion of completed producers"Piotr Wielebski1-11/+14
2019-11-04Add graph for processing time without routingRemigiusz Janeczek1-1/+117
Issue-ID: DCAEGEN2-1858 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I9a3069e639bd723c9ea02b98de412a41cfb4eb5d
2019-11-04Merge "Add option to set kafka retention time for load tests"Piotr Wielebski1-3/+18
2019-11-04Merge "Add test environment rebooting script"Piotr Wielebski2-2/+118
2019-11-04Add option to set kafka retention time for load testsRemigiusz Janeczek1-3/+18
Issue-ID: DCAEGEN2-1783 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: Ib78d018864d9cc220b1f23ab2f3f4340c17cef78
2019-11-04Add test environment rebooting scriptRemigiusz Janeczek2-2/+118
Issue-ID: DCAEGEN2-1883 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I4a3c801d4cc20d1db55f491e2f49133da36da05e
2019-10-24Reorganize deletion of completed producerskjaniak1-11/+14
Load performance test enhancement Change-Id: I8b87ff7fdaaa17dd69cd5136726faa45f497dc71 Issue-ID: DCAEGEN2-1881 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-10-24Cleanup in cloud scriptkjaniak1-8/+10
Change-Id: I8919bbb8403d8d008a678c2310175232eae8df1d Issue-ID: DCAEGEN2-1783 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-10-24Merge "Add load test case to performance script"Piotr Wielebski1-14/+71
2019-10-24Add load test case to performance scriptkjaniak1-14/+71
This is done for cloud script only Change-Id: If66225ab56d04c4f1a9037eca58f89b0c0be1c1e Issue-ID: DCAEGEN2-1881 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-10-23Fix performance test issuesRemigiusz Janeczek2-1/+1
Issue-ID: DCAEGEN2-1783 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I367d109fc5903cd3fd6dbfeeda77d30d780a8a09
2019-10-21Merge "Add setting up consul configuration to cloud performance test shell ↵Piotr Wielebski2-0/+67
scripts"
2019-10-18Add setting up consul configuration to cloud performance test shell scriptsRemigiusz Janeczek2-0/+67
Issue-ID: DCAEGEN2-1783 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I8b1b2c68578e52898af0596a039ecebf764560a0
2019-10-18Improve grafana dashboardsRemigiusz Janeczek3-155/+96
Issue-ID: DCAEGEN2-1858 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: I6ce040a7e9ad4e70c2f8c1139de66b1145cabe5b
2019-10-17Revert - Fix memory usage per pod tablepwielebs3-26/+1
(local deployment) Signed-off-by: pwielebs <piotr.wielebski@nokia.com> Issue-ID: DCAEGEN2-1833 Change-Id: I1119c39ce3b25701a8ea467b90ad052b2c7b0dd0
2019-10-17Merge "Verify system_cpu_usage metric and fix memory usage per pod in cloud ↵Piotr Wielebski1-220/+280
deployment"
2019-10-17Verify system_cpu_usage metric and fix memory usage per pod in cloud deploymentpawel1-220/+280
Issue-ID: DCAEGEN2-1855 Signed-off-by: pawel <pawel.kasperkiewicz@nokia.com> Change-Id: I99ffdf23515ebe9c070abc5b1993db0cebaedf80
2019-10-17Reorganize of Performance tests dashboardkjaniak1-70/+72
Change-Id: I4fc7c90034c5c060d50c740eb567c992bf29fe74 Issue-ID: DCAEGEN2-1783 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-10-16Move certificates directory creation to dockerfileRemigiusz Janeczek1-2/+0
Issue-ID: DCAEGEN2-1783 Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com> Change-Id: If4d9c0dab255ce4f2024f06da40c724dd98d7e5f
2019-10-15Fix of hv-ves consumer image versionkjaniak1-2/+2
Changed image version of consumer in performance tests Change-Id: If83a334defc301ffb89e6596f5f23acac25b0216 Issue-ID: DCAEGEN2-1783 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-10-13Merge "Fix memory usage per pod table"Tony Hansen3-1/+26
2019-10-13Merge "Fix of configmap issue"Tony Hansen1-3/+6
2019-10-11Fix of configmap issuekjaniak1-3/+6
Change-Id: Ia24f86ac0a516dea06b2e4d6c2d0479005864493 Issue-ID: DCAEGEN2-1783 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-10-11Fix memory usage per pod tablepwielebs3-1/+26
(local deployment) Signed-off-by: pwielebs <piotr.wielebski@nokia.com> Issue-ID: DCAEGEN2-1833 Change-Id: I242c3a9bac523997d91c218ec21b05e79006db96
2019-10-11Add SSL support to cloud performance testskjaniak5-6/+63
Change-Id: Ie0a6341592efe3bfe3e386c01026600d16110cef Signed-off-by: kjaniak <kornel.janiak@nokia.com> Issue-ID: DCAEGEN2-1827
2019-10-08Add graphs for performance monitoringkjaniak3-93/+361
Performance tests need graphs representing: total, message queue on HV-VES, offset per kafka topic partition, incoming data rate. Added deletion of producers at test end. Gauges for offsets turned to Range vector (distinguishable based on tag). Since Producer is to fast it was reconfigured to send messages with 1 ms interval. Change-Id: I09fc1edbcd824294d0bb89acc2ea2306a6df00ca Issue-ID: DCAEGEN2-1807 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-10-03Setup Grafana on Cloud (hv-ves)pawel7-0/+2089
Issue-ID: DCAEGEN2-1784 Signed-off-by: pawel <pawel.kasperkiewicz@nokia.com> Change-Id: I87159f360854dccb56e9393bfbe87f66f71dcb6e
2019-09-26Add partition offset metric to each topic partitionkjaniak3-4/+4
Before this commit offset consumer was able to fetch offset just from one partition. This commit solve this. Change-Id: I2c2c300219e43ab422b237094ad775ca8795169e Issue-ID: DCAEGEN2-1783 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-09-06Add Prometheus deployment for HV-VES performance tests - cloudkjaniak7-7/+226
Script for cloud is updated with proper prometheus config and deployment. Change-Id: Icf2527e76bc2028807653313c8ec978d779c6ec9 Issue-ID: DCAEGEN2-1692 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-08-06Merge "Setup grafana for local performance tests"Piotr Wielebski8-6/+1859
2019-07-19Fix of hv-ves dns configurationkjaniak1-5/+1
Change-Id: I2f859c5a683fb9de0efd2ba93dcd853d8f70df1d Issue-ID: DCAEGEN2-1664 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-07-17Adding script for Performance tests of HV-VES on cloudkjaniak5-22/+163
Change-Id: If71b0e8b04ce23a5daafef632788667ccd50c1a1 Issue-ID: DCAEGEN2-1664 Signed-off-by: kjaniak <kornel.janiak@nokia.com>
2019-07-17Setup grafana for local performance testsIzabela Zawadzka8-6/+1859
Signed-off-by: Izabela Zawadzka <izabela.zawadzka@nokia.com> Issue-ID: DCAEGEN2-1666 Change-Id: I49bfccd30e4089a30a235957d3f1a404bfba5e76
2019-07-12Use consumers in mainIzabela Zawadzka2-4/+5
It includes --disable-processing flag. Also fixed some issues with script for local performance test. Also added KafkaConsumer::poll in OffsetKafka Consumer - without it KafkaConsumer::assignment returns empty set Signed-off-by: Izabela Zawadzka <izabela.zawadzka@nokia.com> Issue-ID: DCAEGEN2-1657 Change-Id: I95fadb45f321398346094dfa0c4a6e9da954c186
2019-07-05Add performance test producer deployment yamlJakub Dudycz9-10/+196
- create cloud performance test directory structure - move consumer deployment file to "tools/performence/cloud" directory Change-Id: Ia5c6d8ed15a2188ff9306cf788052f432dae1e33 Signed-off-by: Jakub Dudycz <jakub.dudycz@nokia.com> Issue-ID: DCAEGEN2-1652
2019-07-03Create script to run performance test locallyJakub Dudycz28-0/+3133
Change-Id: I6bbf0e9b029aef1558008286f0fbec83b76be44c Signed-off-by: Jakub Dudycz <jakub.dudycz@nokia.com> Issue-ID: DCAEGEN2-1641