aboutsummaryrefslogtreecommitdiffstats
path: root/docker-compose
AgeCommit message (Collapse)AuthorFilesLines
2025-01-24Disable JVM process metrics by defaultdanielhanrahan1-0/+1
Issue-ID: CPS-2583 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I9c7a543201a63c1f128737bb0995843af6075a6b
2025-01-24Merge "Add dashboard for Inventory REST interfaces"Daniel Hanrahan2-217/+25
2025-01-24[k6] 50000 CM-handlesdanielhanrahan1-2/+2
- Increase CM-handles to 50000 in k6 tests - Increase container memory to 3GB (crashes with 2GB) - Decrease max heap percentage to 70% to ensure container has at least 200MB free memory, to prevent JVM from crashing at higher peak loads. Issue-ID: CPS-2584 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I8daabff58723114bdc3838b379e83c3ffbbb0ba9
2025-01-21Add dashboard for Inventory REST interfaceshalil.cakal2-217/+25
- rename lcm-state dashboard to inventory - remove panels holding a single state of cm handle - add panel for inventory APIs calls by URI and the STATUS Issue-ID: CPS-2567 Change-Id: I374fa18b53d456519142cf059f74b2a070485355 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2025-01-20Increase JVM heap to 75% againdanielhanrahan1-1/+1
Heap percent was commented out by mistake leading to OutOfMemoryError in endurance pipeline, due to only 25% of memory being used for heap. Issue-ID: CPS-2570 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ifbffe7222e38f017105cfac8bc8307255d28d11a
2025-01-17Merge "One SchemaSet per moduleSetTag"Sourabh Sourabh1-6/+5
2025-01-16Add LCM State dashboard to Grafanahalil.cakal2-0/+563
- adding a grafana dashboard for lcm state changes of cm handles Issue-ID: CPS-2558 Change-Id: Ie00884736ffa5c08e1be150c71cf8ac603f2ab60 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2025-01-16One SchemaSet per moduleSetTagToineSiebelink1-6/+5
- Registration: create and upgrade cases. - Handle moduleSetTag deletion (all orphans) for testware - Unit tests updated - additional logging of details for upgrade scenarios - Integration Tests updated - Remove cache for module sets being processed - Removed DbCleaner (startup) - Removed redundant methods in NCMP Inventory for deleting schema set(s) - Removed validation check for all schema set interactions - Updated some schema set tests to use special characters previously not allowed - Checked integration test scenarios for upgrades with and without tags: all scenarios covered! TODO - REST endpoint to remove orphaned schema set data, separate story: CPS-2554 - Investigate exception handling regarding DuplicateYangResourceException: CPS-2555 Issue-ID: CPS-2540 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: Iaa59cbdb86b7a4a8044624829bc002506ff40cc7
2025-01-13Change image of Grafana in local docker-composehalil.cakal1-1/+1
- change image of grafana to grafana/grafana from grafana/grafana-oss in local docker-compose file Issue-ID: CPS-2559 Change-Id: I03bf895c10a108c9aeae2db6b2dc6b39db505df5 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-12-04Add persistent storage to prometheushalil.cakal2-3/+41
- add healthcheck to ensure prometheus service is running correctly and restarts it if it becomes unhealthy - set the data retention time to 30d - update readme Issue-ID: CPS-2466 Change-Id: I0f6186f8577e8e0113831ed040298b823e33d624 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-12-04Plot metrics for each cps-and-ncmp instance separately in Grafanahalil.cakal3-2/+14
- assing port range to cps-and-ncmp service to plot metrics separately Issue-ID: CPS-2536 Change-Id: Ic097017bbcca25f28341e8e77f658a0a4e8964d7 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-11-27[CPS] Reverted ncmp-dmi-plugin version to latestsourabh_sourabh1-1/+1
- Reverted DMI_VERSION to latest Ncmp-dmi-Plugin 1.6.0-SNAPSHOT-latest for CSIT. - Corrected dmi-stub docker image name from "dmi-plugin-demo-and-csit-stub" to "dmi-stub" Issue-ID: CPS-2499 Change-Id: I99087b7230a40e958b3b789549a4a8e4c9dd0341 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-11-01Add docker compose deployment for endurance testshalil.cakal2-18/+55
- add new config file containing env variables for endurance test - add notes to describe how to run and stop it Note 1: Existing docker-compose deployment won't be affected by this changes Note 2: Both docker-compose can be deployed simultaneously without any issue Issue-ID: CPS-2463 Change-Id: I15936718dda2f31a5077b9c36eded21c1a85dfcd Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-10-18Enable 2 minute initial module processing delaydanielhanrahan1-1/+1
Issue-ID: CPS-2403 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I614313461bd36ca351a8d42d9683b88460090b50
2024-10-10Merge "Autodiscover cps-and-ncmp containers when load balancing"Daniel Hanrahan2-10/+10
2024-10-09Autodiscover cps-and-ncmp containers when load balancinghalil.cakal2-10/+10
- remove hard-coded container names from load balancer(nginx) and prometheus Issue-ID: CPS-2437 Change-Id: Ia64b949c2eb3e4d67e123b046e66d5bfdda2c801 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-10-09Fine tune JVM parameters for cps-and-ncmphalil.cakal1-4/+2
- limit the total memory with 2G - set heap memory 75% of the total RAM Issue-ID: CPS-2180 Change-Id: Ia8a6c2bd40866052caba4f332ac563e1ed829212 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-10-03Policy Executor: handle errors, part 2ToineSiebelink2-0/+9
(fighting between IntelliJ and Checkstyle best practices) - non-2xx responses are processed using web client exceptions - handle unknown host exception - upgraded spotbugs (checkstyle and related mvn plugin) - fixed some small spotbugs due to upgrade - added commented instructions in docker compose to enable debugging - added some environment variables for policy executor configuration - extract out Sleeper in stub service to achieve 100% coverage - added cause to Policy Executor exceptions where applicable - ignored (new) spotbug rule about catch NPE because of issue in 3pp - ignored (new) spotbug rule about \n in string due to multiline string block Issue-ID: CPS-2412 Change-Id: I6835a73320c436cbeea12cc7a06f15899eec7bf1 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2024-09-19Make nginx load balance using least-connectionsdanielhanrahan1-1/+3
By default, nginx uses round robin for load balancing. Round robin works well when all requests take same amount of time, but is not optimal for dynamic loads. With least-connected load balancing, nginx will try not to overload a busy server with excessive requests, sending requests to a less busy server instead. Issue-ID: CPS-2415 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I0e7d6b36a79aa6541f2f5f667746f2792d55e54b
2024-09-17Policy Executor API: Add Prefix in YamlToineSiebelink1-1/+3
- Remove servers from yaml. - Add prefix to path in yaml. - Remove basepath prefix from Controller Impl. - Added policy server port to 8093. - Exposed docker env. vars for policy services. Issue-ID: CPS-2291 Change-Id: Idcc9e23f9d63bad2480537dc8d39523fe82b4b83 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-09-04K6 Performance Graph fails frequentlysourabh_sourabh1-0/+1
- Overrides initial processing delay of every new module set tag for DMI plugin stub from 2 min (default) to 0 as a temp. solution. Issue-ID: CPS-2395 Change-Id: Ic875262314406ec55457e31a69c00d55293c1b74 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-08-23Support 2 CPS instances in Prometheus/Grafanadanielhanrahan8-8/+3642
- Specify both cps-and-ncmp instances in Prometheus config - Add default JVM Micrometer dashboard to Grafana, taken from https://grafana.com/grafana/dashboards/4701-jvm-micrometer/ Issue-ID: CPS-2314 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I24a42b8b4771a7d9341e920fbd85fa72e1a3518e
2024-07-31Effect changes on scheduled tasks (don't want scheduled tasks to be monitored)sourabh_sourabh1-0/+13
- Applied a filter on tasks.scheduled.execution. - It is configurable from application.ymal into cps.scheduled-task-names: - tasks.scheduled.execution by default. - Added a new property configuration bean for open telemetry. - Introduced new propery attribute that takes list of task names to be filtered. Issue-ID: CPS-2250 Change-Id: I8e5334cd166343181df6dd1985471f5465f14f0e Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-07-31Add k6 for legacy async batch passthrough read operationhalil.cakal1-0/+12
- add kafka support to k6 codebase - add two new tests: data operation batch passthrough read and data operation async batch read (from kafka) - calculate the events/second via Trend - add kafka ui support to docker-compose Note: Before this commit being merged, the k6 executable should have been compiled with the kafka extension of xk6-kafka Issue-ID: CPS-2268 Change-Id: Ib7777b7bc9f15b210ea36d3541cba0e0c943f883 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-07-16Separate dmi delay for passthrough operationshalil.cakal1-1/+2
- set dmi delay to 670 ms for passthrough write (CUD) - set dmi delay to 300 ms for passthrough read Issue-ID:CPS-2285 Change-Id: I7a4294d3ed04c89aeb5988a9975516135317af12 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-07-10Remove nginx logs that not being used anywherehalil.cakal1-1/+0
Issue-ID: CPS-2038 Change-Id: Iba8950db4f3fcfc13f32bf915189f5fcb2ccee90 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-07-09Merge "Create PolicyExecutor Stub"Sourabh Sourabh1-0/+9
2024-07-08Create PolicyExecutor StubToineSiebelink1-0/+9
- Generate interface from OpenApi in RTD docs - Fixed Content Type in OpenAPI - Fixed Paths in OpenAPI - Made Authorization header compulsory in OpenAPI - All 'enum' values in OpenAPI lowercase (in linr with CPS/NCMP conventions) - Added impl with some basic functionality - Added testware - Pom includes docker image creation - Docker compose updated to deploy stub Issue-ID: CPS-2301 Change-Id: I462ad5c70474b2813fc04005c0d20a1b15b574ec Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-07-01Setup automated tests with two replicas of cps-and-ncmphalil.cakal3-5/+69
- this change for two test suits: CSIT and K6 - increase cps-and-ncmp replicas to 2 - introduce nginx as load-balancer - set proxies inside nginx for the cps-and-ncmp URI paths - upgrade hazelcast-spring to 5.3.7 Issue-ID: CPS-2038 Change-Id: If1b6c1e1218af16b24cc061507ea9b25d277d143 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-06-26Disable the java debug port permanentlyhalil.cakal1-2/+2
Issue-ID: CPS-1864 Change-Id: I0366b126920cf0bc706545bc5b4e469d3faa2486 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-06-14Update ONAP DMI version in NCMPmpriyank1-1/+1
- update the docker compose file to point to latest version on onap-dmi-plugin. Same to be used to run the CSITs during build. Issue-ID: CPS-2271 Change-Id: Ifbb2ee9c9548d54979a04595e19062d9192bfd1d Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2024-03-19Set Postgres shared_buffers in docker-composedanielhanrahan2-0/+3
By default, Postgres uses value of 128MB for shared_buffers, regardless of available memory. It is recommended to use between 25% and 40% of memory for shared_buffers in Postgres. Current value can be checked in SQL using 'SHOW shared_buffers'. Issue-ID: CPS-2156 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ib20502f159f005ba941f39758555551f447d2b67
2024-02-23Use default values for timers in docker-composedanielhanrahan1-3/+0
docker-compose.yml is overriding NCMP timers, e.g. module sync timer is overridden from default of 5 seconds to 30 seconds, which negatively affects performance testing. Issue-ID: CPS-2119 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ic664169ddeed9cce59416dde50ec919cfcea522a
2024-02-12Add a configurable delay to the DMI stubJvD_Ericsson1-0/+3
Added realistic default delay to application.yaml Added realistic default delay to docker-compose.yml Issue-ID: CPS-2053 Signed-off-by: JvD_Ericsson <jeff.van.dam@est.tech> Change-Id: I756774e9538926aa341f1338fcb6882951ce3e69
2024-02-01Set resource limits of docker-compose containersdanielhanrahan1-1/+17
Without explicit limits, docker will use all available system resources for containers. In order to better detect/reproduce performance issues, limits are set to reflect those used in our production deployment. Issue-ID: CPS-2048 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I0549b7f9e57dff10c8b09d839ffb4979d66c643e
2024-01-08Clean up cps temporal related notification codeJvD_Ericsson1-1/+0
- remove 'test' level folder - remove schemas but leave structure - remove 'data-updated' from test application.yaml - remove NOTIFICATION_DATASPACE_FILTER_PATTERNS from docker-compose Issue-ID: CPS-2005 Signed-off-by: JvD_Ericsson <jeff.van.dam@est.tech> Change-Id: I3962d795c760de6ba5ff353e85894895437ad5e7
2023-12-18Remove Notification code for updated eventsmpriyank2-4/+0
- removed existing code for sending notifications to topic cps.dataupdated events formerly used by cps-temporal - corresponding testware removed or updated - unnecessary to fetch anchor details for delete and replace operation removed which might gain minor performance boost - yaml configurations , documentation removal and update - Added missing test for AsyncConfig to comply with coverage check Issue-ID: CPS-2005 Change-Id: I1848f7f229cb713fe8c0302ea50328e7451652ee Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2023-12-11Uplift Onap dmi version to 1.5.0-SNAPSHOThalil.cakal1-1/+1
Issue-ID: CPS-1987 Change-Id: I22b123a5df5ec9340c6303d7dfbaf981857f4a0c Signed-off-by: halil.cakal <halil.cakal@est.tech>
2023-11-06[BUG] CPS NCMP management endpoints updatempriyank2-4/+2
- CPS and NCMP management endpoint updated from /manage to /actuator now - The management port is same as application port now - CSIT test cases update - Update in Security params to allow the changed URL. - Admin guid update - Release notes updated - Local docker-compose and prometheus updated Issue-ID: CPS-1923 Change-Id: I013d35fd96d393dec8cf067bbeae0f92b6b8d8db Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2023-10-10Add debug port to ncmp in docker-composehalil.cakal1-0/+2
Issue-ID: CPS-1864 Change-Id: I6dd77b29b8a73c8d3b893fb3eafb45292b526be2 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2023-08-21Add verification flow in CSIT: Cm Data Subscription Createhalil.cakal1-5/+6
- Add Confluent Kafka Library support for Robot Framework - Add capability of testing for Kafka flows - Add CSIT test: Cm Data Notifications Subscription Create complying with CloudEvents - Change DMI version to latest for CSIT - Change DMI service name for Kafka topic extension - Change kafka listeners in docker compose Issue-ID: CPS-1613 Change-Id: Ic22cb36fdcee0f5c2bd6ff5c1876747aef563f8b Signed-off-by: halil.cakal <halil.cakal@est.tech>
2023-07-13Introduced a dmi rest demo csit stubsourabh_sourabh1-7/+9
- Introduced a new response code 0 for data operational success response. - Created a new dmi plugin rest stub for demo and performance testing. - Removed dmi plugin stub of wiremocked. - Updated parent pom to add newely created demo stub. - updated docker compose to add neww demo stub with profile for CSIT, demo and performance testing. - Removed target id list from unsupported operation/datastore from REST response. Issue-ID: CPS-1560 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech> Change-Id: Ie8198366df820e7d4b8b6e8a85ff9cdb0fce7435 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2023-05-17Change dmi plugin version to 1.4.0-SNAPHOSThalil.cakal1-1/+1
Issue-ID: CPS-1507 Change-Id: Ic812bd1be455d9df663e018383dd1d5c15359362 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2023-04-05Expose endpoint to accept bulk requestleventecsanyi1-2/+2
- added wiremock mapping for testing/demo Issue-ID: CPS-1555 Change-Id: I82af6c43e80a346efcd84aae8945572aa37a6875 Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
2023-03-03JAVA onboarding of YANG modelemaclee3-92/+0
- removed docker compose init container - removed init container script files - created new model loader class to onboard YANG model which runs after the application has set up - new model loader class is created in new package in cps-service (org.onap.cps.ncmp.init) Issue-ID: CPS-1467 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech> Change-Id: I35fe82817aff7783520acf8db66ad504271026bd
2023-02-15Introducing GrafanaToineSiebelink2-2/+57
- Added profiles to docker compose: dmi-service/dmi-stub, monitoring - NOTE: now need to add '--profile dmi-service' to enable dm-plugin (e.g. for csit) - using container names to resolve hosts for prometheus Issue-ID: CPS-1465 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: I5d7365a3f789cc698e2702d72700a002cf03eaef
2023-02-02Modify CSIT script to have absolute root path envemaclee1-3/+2
- change set up to call docker compose for cps-ncmp - add root as a property in 'test.properties' - root is specified to be root directory folder for the current project - modified docker compose init container to use ROOT env var Issue-ID: CPS-1472 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech> Change-Id: Ie5ac6bbff7cb1e761501bd0db8447f86af06b95f
2023-01-31Introduce InstrumentationToineSiebelink1-1/+1
- Add instrumentation related dependency - Added Timed Instrumentation - CPS-Service Crud methods - CPS Yang parsing - NCMP Registration methods - NCMP Events handling - Remove manual Gauge for YanResources Cache as (better!) instrumentation is already built into the 3PP - Sorted dependecies alphabetically (as we used to enforce, to prevent duplicates) - Added ## P E R F O R M A N C E T E S T R E S U L T S ### mini report - (unrelated) test improvement (because of bug that turned out to be invalid) Reviewers: Sourabh,Priyank, Luke Issue-ID: CPS-1457 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: I34b20bece2f59488b022b8effa9470704c57be4d
2023-01-27Define and onboard model for subscription eventsemaclee3-1/+94
- created new yang model for subscription events; added in ncmp-service - created new container/service to run an init container - added script file to the container - added Dockerfile to be the base image of the init container - health check for CPS added as part of script - removed previous patch modification in setup - changed path of models and dockerfile to main project - latest patch: changed connection to external ports of CPS Issue-ID: CPS-1393 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech> Change-Id: I2367020e57b34a669dda93050eeaeede5846304e
2022-10-27Updating CSIT DMI Snapshot versionToineSiebelink1-1/+1
Update default and DMI_VERSION property in test.prooerties Issue-ID: CPS-1353 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: Ibe56f85fb047aca1d10e0d61a521c7448bd4306b