summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2024-10-17Release cps3.5.4jenkins-releng21-21/+21
2024-10-17Release notes and documentation updates for 3.5.4danielhanrahan11-31/+16
- Release notes update - Update openapi info.version to 3.5.4 - Update scheduled-tasks docs to reflect changes in retry mechanism - Update deployment docs to update configurable timer parameters - Remove unused locked-module-sync.sleep-time-ms Issue-ID: CPS-2457 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ieb559bbfe348848c4b8669410861edfeeb6c9bf3
2024-10-17Refactor and Optimize ModuleSyncWatchdog for Improved Lock Handling and ↵sourabh_sourabh6-38/+82
Queue Management - Enhanced logging for populateWorkQueueIfNeeded and resetPreviouslyLockedCmHandles methods, improving clarity and error handling. - Improved readability and maintainability of the locking mechanism with Hazelcast's FencedLock. - Optimized error handling in catch blocks, logging detailed exception messages and stack traces for better troubleshooting. - Refined lock acquisition and release flow, with clear log messages for both successful and failed lock operations, ensuring safe handling of Hazelcast distributed locks. Issue-ID: CPS-2403 Change-Id: Ie089f36a817d4965782235b51ee987ef054516b1 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-10-16Merge "Update documentation related to hazelcast"Toine Siebelink4-13/+11
2024-10-16Update documentation related to hazelcastmpriyank4-13/+11
- removed old entries of data structures which are removed now. - updated the documentation to correctly reflect our infrastructure startegy related to hazelcast. - fixed few NB comments on the merged patch. Issue-ID: CPS-2408 Change-Id: Id7ce4ac695ad94742490ac5d2be89cd23ffda3e5 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2024-10-16Merge "Add missing duplication test in integration test suite"Sourabh Sourabh2-1/+28
2024-10-16Merge "Added additional logging"Daniel Hanrahan1-0/+16
2024-10-15Add missing duplication test in integration test suiteToineSiebelink2-1/+28
- Added test for ModuleSerive.createSchemaSetFromModules() - Unintendedly Updated one swagger file in docs because 1) DT team forgot to update the relevant file 2) Gers committed pom update to automatically update swagger files 3) I ran 'mvn install' Issue-ID: CPS-2399 Change-Id: I33261c32bbca58ff21aff3cde9588617199f104c Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2024-10-15Added additional loggingsourabh_sourabh1-0/+16
- Added logging for non existing xpath while updating data notes and its decendants. Issue-ID: CPS-2403 Change-Id: I1ecaf2aed77aec8d266f6a758fe80ee96717d9c7 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-10-15Merge "add documentaiton for cps-and-ncmp deployment"Priyank Maheshwari1-2/+12
2024-10-15add documentaiton for cps-and-ncmp deploymenthalil.cakal1-2/+12
- the optimum percentage of the JVM allocation documented - remove anchorDataCache from the documentation since no more used Issue-ID: CPS-2180 Change-Id: Ie1b8c43136a38f8da5a865493bed1df030a497d6 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-10-14Merge "Copy Swagger file to docs folder"Toine Siebelink2-0/+38
2024-10-10Merge "use one hazelcast instance per jvm"Lee Anjella Macabuhay11-66/+75
2024-10-10use one hazelcast instance per jvmmpriyank11-66/+75
- updated all the cache(distributed datastructures) to use the same instance config now. - there will be just one instance per JVM now - Better cleanup of hz instance in the testware - Refactored the testware to verify the configs - Expected Impact on lowering the memory usage, less number of TCP communications between members - NOTE: we need to do a full regression as the changes impacts all the use cases which involves cache Issue-ID: CPS-2408 Change-Id: I7564992a9990f44ef3defb4f50cb7d094cad7b92 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2024-10-10Copy Swagger file to docs folderegernug2-0/+38
To avoid manual copy/paste errors updates to docs folder for RTD are generated and copied when compiling CPS Issue-ID: CPS-2332 Change-Id: I1a64f7cc74a82341403f8125adc5216ef046429c Signed-off-by: egernug <gerard.nugent@est.tech>
2024-10-10Merge "Autodiscover cps-and-ncmp containers when load balancing"Daniel Hanrahan2-10/+10
2024-10-09Merge "Added architecture tests to validate ONLY NCMP REST/Service dependencies"Sourabh Sourabh2-72/+98
2024-10-09Added architecture tests to validate ONLY NCMP REST/Service dependenciesleventecsanyi2-72/+98
- removed old tests and added new test cases for the NCMP controller and service layers - other dependencies will be added in later commits Issue-ID: CPS-2422 Change-Id: Iabc4b53e9414477cf3d0b2e1e5a03ba8b4995169 Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
2024-10-09Merge "Added K6 script test to check a throughput of CPS kafka consumer"Daniel Hanrahan2-0/+137
2024-10-09Merge "Implementation of Data validation feature in Create a Node API"Toine Siebelink15-39/+278
2024-10-09Autodiscover cps-and-ncmp containers when load balancinghalil.cakal2-10/+10
- remove hard-coded container names from load balancer(nginx) and prometheus Issue-ID: CPS-2437 Change-Id: Ia64b949c2eb3e4d67e123b046e66d5bfdda2c801 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-10-09Fine tune JVM parameters for cps-and-ncmphalil.cakal1-4/+2
- limit the total memory with 2G - set heap memory 75% of the total RAM Issue-ID: CPS-2180 Change-Id: Ia8a6c2bd40866052caba4f332ac563e1ed829212 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-10-09Implementation of Data validation feature in Create a Node APIArpit Singh15-39/+278
Added support to validate JSON/XML data without the need of persisting it in the databse. - added "dryRunInQuery" flag as a new query parameter - added new method as part of CpsDataService layer to perform data validation - added new method in yang parser "validateData" to validate data without persisting it Issue-ID: CPS-2361 Change-Id: I43dd33cc6120576d0fac606d5c4b0168d107311d Signed-off-by: Arpit Singh <as00745003@techmahindra.com>
2024-10-08Merge "Policy Executor: handle errors, part 2 (fighting between IntelliJ and ↵Sourabh Sourabh21-79/+235
Checkstyle best practices)"
2024-10-07Merge "Re-adjust cps expectations"Lee Anjella Macabuhay1-13/+13
2024-10-07Merge "RTD update for delta API 2"Priyank Maheshwari2-25/+41
2024-10-04Bump CPS to 3.5.4-SNAPSHOTmpriyank23-23/+51
- bump cps to 3.5.4-SNAPSHOT - updated release notes Issue-ID: CPS-2434 Change-Id: I3d5e6f37711bb29b61b598cc5af57ecfdc35cbba Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2024-10-04[CPS] Step-3: OSLO release changessourabh_sourabh1-0/+8
- cps maven stage docker yaml is created for release 3.5.3 Issue-ID:CPS-2434 Change-Id: I4048b9f54b9c0b0eb433fef9d9c403d54c39bc35 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-10-04[CPS] Step-2: OSLO release changessourabh_sourabh1-0/+4
- cps maven stage master yaml is created for release 3.5.3 Issue-ID:CPS-2434 Change-Id: I5353eb64252b3e071b5203d931f0f646ef290c13 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-10-04[CPS] OSLO release changessourabh_sourabh4-163/+254
- Updated open api for cps, ncmp and policy apis. - Updated release notes with bus and features. Issue-ID: CPS-2434 Change-Id: Ib4d80f3939b6e267f228177c817e43832a9384db Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-10-04Merge "[BUG] Fix memory leak related to using arrays in Hibernate"Lee Anjella Macabuhay9-100/+72
2024-10-04Revert "[1/2] Move Swagger API to docs folder"Lee Anjella Macabuhay12-910/+2428
This reverts commit b76392e2d1629d4eb67b10c450cdd954ef678966. Reason for revert: Release blocker Change-Id: Ic477dbaaad34992c8f440981d92f12b977cdf96e Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
2024-10-04RTD update for delta API 2Arpit Singh2-25/+41
- Documentation update for Delta Feature and Delta API 1 - Added documentation for API 2: Delta between anchor and JSON payload Issue-ID: CPS-2212 Signed-off-by: Arpit Singh <as00745003@techmahindra.com> Change-Id: Id74cd930ce48e5cb414aa62c5381b79675346a37
2024-10-03[BUG] Fix memory leak related to using arrays in Hibernatedanielhanrahan9-100/+72
The use of arrays like String[] instead of Collection<String> in JpaRepository methods is causing a memory leak, most likely due to a bug in the hypersistence-utils dependency which provides the feature. Note code using arrays in JDBC (via jdbcTemplate) is not affected. This patch removes most uses of arrays in Java, except one needed for FragmentPrefetchRepository using JDBC setArray(), which is safe. Issue-ID: CPS-2430 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I94f8c3d4c8c32ebe0978c08d3226a196a95bf3b9
2024-10-03Revert "Fix inputSpec for openapi code gen"Lee Anjella Macabuhay1-2/+2
This reverts commit 4baa75b06dcfb9365a8ea5cde03d77d7f21fa01c. Reason for revert: Release blocker Change-Id: I6156461de64dcec41e3f84cbd0cf90f63938bea6 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
2024-10-03Revert "CI: Add test (silent) checkov scan as part of the verify process"Jessica Wagantall1-151/+0
This reverts commit c8e2b3383830395bb4bc37371a9c6119a316cb53. Issue-ID: CIMAN-33 Change-Id: I5120097ad05394e3667a868c4b7edd44ef1aa070 Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
2024-10-03Policy Executor: handle errors, part 2ToineSiebelink21-79/+235
(fighting between IntelliJ and Checkstyle best practices) - non-2xx responses are processed using web client exceptions - handle unknown host exception - upgraded spotbugs (checkstyle and related mvn plugin) - fixed some small spotbugs due to upgrade - added commented instructions in docker compose to enable debugging - added some environment variables for policy executor configuration - extract out Sleeper in stub service to achieve 100% coverage - added cause to Policy Executor exceptions where applicable - ignored (new) spotbug rule about catch NPE because of issue in 3pp - ignored (new) spotbug rule about \n in string due to multiline string block Issue-ID: CPS-2412 Change-Id: I6835a73320c436cbeea12cc7a06f15899eec7bf1 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2024-10-03Added K6 script test to check a throughput of CPS kafka consumersourabh_sourabh2-0/+137
- Added new K6 script to produce cm avc enents. (It is not a part regular automated tests) - Added a json resource (avc event) Issue-ID: CPS-2329 Change-Id: I6446bc120382257c5039df17fd34b84b7c6f6550 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-10-03Re-adjust cps expectationshalil.cakal1-13/+13
- aligning cps expectation for new plots Issue-ID: CPS-2350 Change-Id: I5b300c4f5432bf2bdfe8a8b0d52b2ce60bd338d6 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-10-03Update JIRA and Wiki links host name from wiki.onap.org to lf-onap.atlassian.netsourabh_sourabh10-248/+248
Issue-ID: CPS-2432 Change-Id: I53f380a4fe0968d1ec9f1393651c7c43f03d0d95 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-09-30Merge "BugFix: 500 Server error when upgrade and service restart with data ↵Sourabh Sourabh2-1/+6
in DB"
2024-09-27Fix inputSpec for openapi code genegernug1-2/+2
Existing inputSpec only accessible from cps root. Changing path to be accessible elsewhere Issue-ID: CPS-2332 Change-Id: I94ada93ea3c88d2fdca84d49c21e1ffc2923f4b2 Signed-off-by: egernug <gerard.nugent@est.tech>
2024-09-26Merge "[1/2] Move Swagger API to docs folder"Toine Siebelink12-2428/+910
2024-09-25CI: Add test (silent) checkov scan as part of the verify processJessica Wagantall1-0/+151
Issue-ID: CIMAN-33 Change-Id: I70b171824acb913f67fd28c119bfbcbc1cc1e470 Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
2024-09-25BugFix: 500 Server error when upgrade and service restart with data in DBhalil.cakal2-1/+6
- return NONE for get effective trust level api if the trustlevel caches empty (restart case) Issue-ID: CPS-2409 Change-Id: I72a755ca6ba5d4a78f5458a235c0d1f43aaa8d53 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-09-25Merge "[k6] CM handles searches using different filters"Priyank Maheshwari4-30/+181
2024-09-25Policy Executor: handle errorsToineSiebelink10-45/+147
- configurable default answer - apply default answer upon non 2xx response - delayed default webclient read timeout - add custom timeout method with original read timeout in seconds - apply default answer upon timeout - add integration test with short timeout error scenario Issue-ID: CPS-2412 Change-Id: I62527a27e426c2f01fda2182ebd2513242c29ac1 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2024-09-24Remove Hazelcast cache for prefix resolver (CPS-2417 #2)danielhanrahan13-349/+27
This patch removes the AnchorDataCache from CPS, which is used for prefix resolution in get/query operations. As such, Hazelcast is no longer a dependency of CPS, only NCMP. - Changed PrefixResolver to be more efficient. - Removed AnchorDataCache and associated classes. - Moved HazelcastCacheConfig to NCMP. - Removed Hazelcast dependency from cps-service/pom.xml This shows good performance improvements in some APIs such as v2 GET which is nearly 2x faster (also 5x faster including base patch). Issue-ID: CPS-2417 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I24768469f24e90b70f7a6187faa4f5b3d75777d2
2024-09-24Fix intermittent error in integration testToineSiebelink1-1/+2
- make collection verification order independent Issue-ID: CPS-475 Change-Id: Ib070fd5360463c93ba6193a84a1dfcd11cd802fa Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2024-09-24Merge "Reduce anchor lookups related to PrefixResolver (CPS-2417 #1)"Toine Siebelink7-43/+46