aboutsummaryrefslogtreecommitdiffstats
path: root/docker-compose
AgeCommit message (Collapse)AuthorFilesLines
2024-11-01Add docker compose deployment for endurance testshalil.cakal2-18/+55
- add new config file containing env variables for endurance test - add notes to describe how to run and stop it Note 1: Existing docker-compose deployment won't be affected by this changes Note 2: Both docker-compose can be deployed simultaneously without any issue Issue-ID: CPS-2463 Change-Id: I15936718dda2f31a5077b9c36eded21c1a85dfcd Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-10-18Enable 2 minute initial module processing delaydanielhanrahan1-1/+1
Issue-ID: CPS-2403 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I614313461bd36ca351a8d42d9683b88460090b50
2024-10-10Merge "Autodiscover cps-and-ncmp containers when load balancing"Daniel Hanrahan2-10/+10
2024-10-09Autodiscover cps-and-ncmp containers when load balancinghalil.cakal2-10/+10
- remove hard-coded container names from load balancer(nginx) and prometheus Issue-ID: CPS-2437 Change-Id: Ia64b949c2eb3e4d67e123b046e66d5bfdda2c801 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-10-09Fine tune JVM parameters for cps-and-ncmphalil.cakal1-4/+2
- limit the total memory with 2G - set heap memory 75% of the total RAM Issue-ID: CPS-2180 Change-Id: Ia8a6c2bd40866052caba4f332ac563e1ed829212 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-10-03Policy Executor: handle errors, part 2ToineSiebelink2-0/+9
(fighting between IntelliJ and Checkstyle best practices) - non-2xx responses are processed using web client exceptions - handle unknown host exception - upgraded spotbugs (checkstyle and related mvn plugin) - fixed some small spotbugs due to upgrade - added commented instructions in docker compose to enable debugging - added some environment variables for policy executor configuration - extract out Sleeper in stub service to achieve 100% coverage - added cause to Policy Executor exceptions where applicable - ignored (new) spotbug rule about catch NPE because of issue in 3pp - ignored (new) spotbug rule about \n in string due to multiline string block Issue-ID: CPS-2412 Change-Id: I6835a73320c436cbeea12cc7a06f15899eec7bf1 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2024-09-19Make nginx load balance using least-connectionsdanielhanrahan1-1/+3
By default, nginx uses round robin for load balancing. Round robin works well when all requests take same amount of time, but is not optimal for dynamic loads. With least-connected load balancing, nginx will try not to overload a busy server with excessive requests, sending requests to a less busy server instead. Issue-ID: CPS-2415 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I0e7d6b36a79aa6541f2f5f667746f2792d55e54b
2024-09-17Policy Executor API: Add Prefix in YamlToineSiebelink1-1/+3
- Remove servers from yaml. - Add prefix to path in yaml. - Remove basepath prefix from Controller Impl. - Added policy server port to 8093. - Exposed docker env. vars for policy services. Issue-ID: CPS-2291 Change-Id: Idcc9e23f9d63bad2480537dc8d39523fe82b4b83 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-09-04K6 Performance Graph fails frequentlysourabh_sourabh1-0/+1
- Overrides initial processing delay of every new module set tag for DMI plugin stub from 2 min (default) to 0 as a temp. solution. Issue-ID: CPS-2395 Change-Id: Ic875262314406ec55457e31a69c00d55293c1b74 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-08-23Support 2 CPS instances in Prometheus/Grafanadanielhanrahan8-8/+3642
- Specify both cps-and-ncmp instances in Prometheus config - Add default JVM Micrometer dashboard to Grafana, taken from https://grafana.com/grafana/dashboards/4701-jvm-micrometer/ Issue-ID: CPS-2314 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I24a42b8b4771a7d9341e920fbd85fa72e1a3518e
2024-07-31Effect changes on scheduled tasks (don't want scheduled tasks to be monitored)sourabh_sourabh1-0/+13
- Applied a filter on tasks.scheduled.execution. - It is configurable from application.ymal into cps.scheduled-task-names: - tasks.scheduled.execution by default. - Added a new property configuration bean for open telemetry. - Introduced new propery attribute that takes list of task names to be filtered. Issue-ID: CPS-2250 Change-Id: I8e5334cd166343181df6dd1985471f5465f14f0e Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-07-31Add k6 for legacy async batch passthrough read operationhalil.cakal1-0/+12
- add kafka support to k6 codebase - add two new tests: data operation batch passthrough read and data operation async batch read (from kafka) - calculate the events/second via Trend - add kafka ui support to docker-compose Note: Before this commit being merged, the k6 executable should have been compiled with the kafka extension of xk6-kafka Issue-ID: CPS-2268 Change-Id: Ib7777b7bc9f15b210ea36d3541cba0e0c943f883 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-07-16Separate dmi delay for passthrough operationshalil.cakal1-1/+2
- set dmi delay to 670 ms for passthrough write (CUD) - set dmi delay to 300 ms for passthrough read Issue-ID:CPS-2285 Change-Id: I7a4294d3ed04c89aeb5988a9975516135317af12 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-07-10Remove nginx logs that not being used anywherehalil.cakal1-1/+0
Issue-ID: CPS-2038 Change-Id: Iba8950db4f3fcfc13f32bf915189f5fcb2ccee90 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-07-09Merge "Create PolicyExecutor Stub"Sourabh Sourabh1-0/+9
2024-07-08Create PolicyExecutor StubToineSiebelink1-0/+9
- Generate interface from OpenApi in RTD docs - Fixed Content Type in OpenAPI - Fixed Paths in OpenAPI - Made Authorization header compulsory in OpenAPI - All 'enum' values in OpenAPI lowercase (in linr with CPS/NCMP conventions) - Added impl with some basic functionality - Added testware - Pom includes docker image creation - Docker compose updated to deploy stub Issue-ID: CPS-2301 Change-Id: I462ad5c70474b2813fc04005c0d20a1b15b574ec Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-07-01Setup automated tests with two replicas of cps-and-ncmphalil.cakal3-5/+69
- this change for two test suits: CSIT and K6 - increase cps-and-ncmp replicas to 2 - introduce nginx as load-balancer - set proxies inside nginx for the cps-and-ncmp URI paths - upgrade hazelcast-spring to 5.3.7 Issue-ID: CPS-2038 Change-Id: If1b6c1e1218af16b24cc061507ea9b25d277d143 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-06-26Disable the java debug port permanentlyhalil.cakal1-2/+2
Issue-ID: CPS-1864 Change-Id: I0366b126920cf0bc706545bc5b4e469d3faa2486 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-06-14Update ONAP DMI version in NCMPmpriyank1-1/+1
- update the docker compose file to point to latest version on onap-dmi-plugin. Same to be used to run the CSITs during build. Issue-ID: CPS-2271 Change-Id: Ifbb2ee9c9548d54979a04595e19062d9192bfd1d Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2024-03-19Set Postgres shared_buffers in docker-composedanielhanrahan2-0/+3
By default, Postgres uses value of 128MB for shared_buffers, regardless of available memory. It is recommended to use between 25% and 40% of memory for shared_buffers in Postgres. Current value can be checked in SQL using 'SHOW shared_buffers'. Issue-ID: CPS-2156 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ib20502f159f005ba941f39758555551f447d2b67
2024-02-23Use default values for timers in docker-composedanielhanrahan1-3/+0
docker-compose.yml is overriding NCMP timers, e.g. module sync timer is overridden from default of 5 seconds to 30 seconds, which negatively affects performance testing. Issue-ID: CPS-2119 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ic664169ddeed9cce59416dde50ec919cfcea522a
2024-02-12Add a configurable delay to the DMI stubJvD_Ericsson1-0/+3
Added realistic default delay to application.yaml Added realistic default delay to docker-compose.yml Issue-ID: CPS-2053 Signed-off-by: JvD_Ericsson <jeff.van.dam@est.tech> Change-Id: I756774e9538926aa341f1338fcb6882951ce3e69
2024-02-01Set resource limits of docker-compose containersdanielhanrahan1-1/+17
Without explicit limits, docker will use all available system resources for containers. In order to better detect/reproduce performance issues, limits are set to reflect those used in our production deployment. Issue-ID: CPS-2048 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I0549b7f9e57dff10c8b09d839ffb4979d66c643e
2024-01-08Clean up cps temporal related notification codeJvD_Ericsson1-1/+0
- remove 'test' level folder - remove schemas but leave structure - remove 'data-updated' from test application.yaml - remove NOTIFICATION_DATASPACE_FILTER_PATTERNS from docker-compose Issue-ID: CPS-2005 Signed-off-by: JvD_Ericsson <jeff.van.dam@est.tech> Change-Id: I3962d795c760de6ba5ff353e85894895437ad5e7
2023-12-18Remove Notification code for updated eventsmpriyank2-4/+0
- removed existing code for sending notifications to topic cps.dataupdated events formerly used by cps-temporal - corresponding testware removed or updated - unnecessary to fetch anchor details for delete and replace operation removed which might gain minor performance boost - yaml configurations , documentation removal and update - Added missing test for AsyncConfig to comply with coverage check Issue-ID: CPS-2005 Change-Id: I1848f7f229cb713fe8c0302ea50328e7451652ee Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2023-12-11Uplift Onap dmi version to 1.5.0-SNAPSHOThalil.cakal1-1/+1
Issue-ID: CPS-1987 Change-Id: I22b123a5df5ec9340c6303d7dfbaf981857f4a0c Signed-off-by: halil.cakal <halil.cakal@est.tech>
2023-11-06[BUG] CPS NCMP management endpoints updatempriyank2-4/+2
- CPS and NCMP management endpoint updated from /manage to /actuator now - The management port is same as application port now - CSIT test cases update - Update in Security params to allow the changed URL. - Admin guid update - Release notes updated - Local docker-compose and prometheus updated Issue-ID: CPS-1923 Change-Id: I013d35fd96d393dec8cf067bbeae0f92b6b8d8db Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2023-10-10Add debug port to ncmp in docker-composehalil.cakal1-0/+2
Issue-ID: CPS-1864 Change-Id: I6dd77b29b8a73c8d3b893fb3eafb45292b526be2 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2023-08-21Add verification flow in CSIT: Cm Data Subscription Createhalil.cakal1-5/+6
- Add Confluent Kafka Library support for Robot Framework - Add capability of testing for Kafka flows - Add CSIT test: Cm Data Notifications Subscription Create complying with CloudEvents - Change DMI version to latest for CSIT - Change DMI service name for Kafka topic extension - Change kafka listeners in docker compose Issue-ID: CPS-1613 Change-Id: Ic22cb36fdcee0f5c2bd6ff5c1876747aef563f8b Signed-off-by: halil.cakal <halil.cakal@est.tech>
2023-07-13Introduced a dmi rest demo csit stubsourabh_sourabh1-7/+9
- Introduced a new response code 0 for data operational success response. - Created a new dmi plugin rest stub for demo and performance testing. - Removed dmi plugin stub of wiremocked. - Updated parent pom to add newely created demo stub. - updated docker compose to add neww demo stub with profile for CSIT, demo and performance testing. - Removed target id list from unsupported operation/datastore from REST response. Issue-ID: CPS-1560 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech> Change-Id: Ie8198366df820e7d4b8b6e8a85ff9cdb0fce7435 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2023-05-17Change dmi plugin version to 1.4.0-SNAPHOSThalil.cakal1-1/+1
Issue-ID: CPS-1507 Change-Id: Ic812bd1be455d9df663e018383dd1d5c15359362 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2023-04-05Expose endpoint to accept bulk requestleventecsanyi1-2/+2
- added wiremock mapping for testing/demo Issue-ID: CPS-1555 Change-Id: I82af6c43e80a346efcd84aae8945572aa37a6875 Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
2023-03-03JAVA onboarding of YANG modelemaclee3-92/+0
- removed docker compose init container - removed init container script files - created new model loader class to onboard YANG model which runs after the application has set up - new model loader class is created in new package in cps-service (org.onap.cps.ncmp.init) Issue-ID: CPS-1467 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech> Change-Id: I35fe82817aff7783520acf8db66ad504271026bd
2023-02-15Introducing GrafanaToineSiebelink2-2/+57
- Added profiles to docker compose: dmi-service/dmi-stub, monitoring - NOTE: now need to add '--profile dmi-service' to enable dm-plugin (e.g. for csit) - using container names to resolve hosts for prometheus Issue-ID: CPS-1465 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: I5d7365a3f789cc698e2702d72700a002cf03eaef
2023-02-02Modify CSIT script to have absolute root path envemaclee1-3/+2
- change set up to call docker compose for cps-ncmp - add root as a property in 'test.properties' - root is specified to be root directory folder for the current project - modified docker compose init container to use ROOT env var Issue-ID: CPS-1472 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech> Change-Id: Ie5ac6bbff7cb1e761501bd0db8447f86af06b95f
2023-01-31Introduce InstrumentationToineSiebelink1-1/+1
- Add instrumentation related dependency - Added Timed Instrumentation - CPS-Service Crud methods - CPS Yang parsing - NCMP Registration methods - NCMP Events handling - Remove manual Gauge for YanResources Cache as (better!) instrumentation is already built into the 3PP - Sorted dependecies alphabetically (as we used to enforce, to prevent duplicates) - Added ## P E R F O R M A N C E T E S T R E S U L T S ### mini report - (unrelated) test improvement (because of bug that turned out to be invalid) Reviewers: Sourabh,Priyank, Luke Issue-ID: CPS-1457 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: I34b20bece2f59488b022b8effa9470704c57be4d
2023-01-27Define and onboard model for subscription eventsemaclee3-1/+94
- created new yang model for subscription events; added in ncmp-service - created new container/service to run an init container - added script file to the container - added Dockerfile to be the base image of the init container - health check for CPS added as part of script - removed previous patch modification in setup - changed path of models and dockerfile to main project - latest patch: changed connection to external ports of CPS Issue-ID: CPS-1393 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech> Change-Id: I2367020e57b34a669dda93050eeaeede5846304e
2022-10-27Updating CSIT DMI Snapshot versionToineSiebelink1-1/+1
Update default and DMI_VERSION property in test.prooerties Issue-ID: CPS-1353 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: Ibe56f85fb047aca1d10e0d61a521c7448bd4306b
2022-09-21Merge "Add NCMP tag in properties"Toine Siebelink1-2/+2
2022-09-20Add NCMP tag in propertiesmpriyank1-2/+2
- Added back NCMP tag back as part of the comment in patch https://gerrit.onap.org/r/c/cps/+/129274 - Added parallelism level under ncmp as well. - Correcting env variable in the docker compose file for local run as well as the CSITs. Issue-ID: CPS-1279 Change-Id: I1f2993ac66f47ee2e5e7db0c4a6aac113a714d2a Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2022-09-19Updated README to correct local deployment detailsrajesh.kumar1-2/+5
Issue-ID: CPS-1263 Change-ID: I73f97f986a817d423f93a8d922dcd9647b0908aa Signed-off-by: rajesh.kumar <rk00747546@techmahindra.com>
2022-08-16Set Sleep Times as Environment Variable in CSITlukegleeson1-2/+2
Sleep times for Model and Data sync were being set to 2 seconds in the docker-compose file so that it may be used in CSIT tests This change defaults them to 30 seconds and adds environment variables which are overridden by the test.properties for CSIT tests Issue-ID: CPS-1195 Signed-off-by: lukegleeson <luke.gleeson@est.tech> Change-Id: Id254e3ec82fb4685fd6678d1a345b16f108b2707
2022-08-10Merge "CSITs for DataStore SyncState"Toine Siebelink1-0/+1
2022-08-10CSITs for DataStore SyncStateemaclee1-0/+1
- add new test for dataSyncEnabled API - verify data sync follows after setting dataSyncEnabled flag Issue-ID: CPS-1168 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech> Change-Id: Ie22a6b8d6be15a05bfa3ee90218af27fe7092dd0
2022-08-05Upgrade Postgres Cps-CoreDylanB95EST1-1/+1
Upgrade postgres version to 14 in accordance with Seccom Issue-ID: CPS-897 Change-Id: I332c88f3c3e1ec3dd55afe31af5714b690b6bd07 Signed-off-by: DylanB95EST <dylan.byrne@est.tech>
2022-07-14Remove ALL Docker File Versionssourabh_sourabh1-3/+1
Issue-ID: CPS-1095 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech> Change-Id: I11790e271ec784dfa9dbdaea497d50e95f884600
2022-07-12Updating docker-compose version from 3.3 to 3.8JosephKeenan1-1/+1
Issue-ID: CPS-1095 Signed-off-by: JosephKeenan <joseph.keenan@est.tech> Change-Id: I31601a1f486a4925ed880283c160cd827fe2255b
2022-06-30Kafka consumer can not be turned offJosephKeenan1-66/+5
-NOTE: Build will fail until docker-compose version issues on build server are fixed --Ticket raised https://jira.linuxfoundation.org/plugins/servlet/theme/portal/2/IT-24219 -added flag for async -added response if async is triggered without being enabled & associated test -modified to use one global flag for notifications Issue-ID: CPS-1088 Signed-off-by: JosephKeenan <joseph.keenan@est.tech> Change-Id: If9d988b4dcb71bf37c1b1bf9464090782708ffc2
2022-06-09Override timers advised-modules-sync sleep-time-mssourabh_sourabh1-0/+1
- Override timers advised-modules-sync sleep-time-ms from docker compose for CSIT test Issue-ID: CPS-876 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech> Change-Id: I2cbc76c03cd5907e2d3bf28b38dbf8209eaaddbd
2022-05-25Async request response NCMP -> ClientJosephKeenan1-7/+56
-Added consumer for DMI events and producer for forwarding to client -Added schemas for events -Updated tests -Added new module for ncmp events -Used mapstruct for event mapping Issue-ID: CPS-830 Change-Id: I096d08af9d69092cf8651e11eaa00ce441fc3605 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech> Signed-off-by: JosephKeenan <joseph.keenan@est.tech> Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Signed-off-by: JosephKeenan <joseph.keenan@est.tech>