aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2024-10-25Support Alternate-Id for CPS-E05 id-searches and searchCmHandleIdsseanbeirne22-160/+310
Issue-ID: CPS-2402 Issue-ID: CPS-2383 Change-Id: I5dd3132b70b401bf2f50f77c2c131d5d34aa0c0a Signed-off-by: seanbeirne <sean.beirne@est.tech>
2024-10-10Merge "use one hazelcast instance per jvm"Lee Anjella Macabuhay11-66/+75
2024-10-10use one hazelcast instance per jvmmpriyank11-66/+75
- updated all the cache(distributed datastructures) to use the same instance config now. - there will be just one instance per JVM now - Better cleanup of hz instance in the testware - Refactored the testware to verify the configs - Expected Impact on lowering the memory usage, less number of TCP communications between members - NOTE: we need to do a full regression as the changes impacts all the use cases which involves cache Issue-ID: CPS-2408 Change-Id: I7564992a9990f44ef3defb4f50cb7d094cad7b92 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2024-10-10Merge "Autodiscover cps-and-ncmp containers when load balancing"Daniel Hanrahan2-10/+10
2024-10-09Merge "Added architecture tests to validate ONLY NCMP REST/Service dependencies"Sourabh Sourabh2-72/+98
2024-10-09Added architecture tests to validate ONLY NCMP REST/Service dependenciesleventecsanyi2-72/+98
- removed old tests and added new test cases for the NCMP controller and service layers - other dependencies will be added in later commits Issue-ID: CPS-2422 Change-Id: Iabc4b53e9414477cf3d0b2e1e5a03ba8b4995169 Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
2024-10-09Merge "Added K6 script test to check a throughput of CPS kafka consumer"Daniel Hanrahan2-0/+137
2024-10-09Merge "Implementation of Data validation feature in Create a Node API"Toine Siebelink15-39/+278
2024-10-09Autodiscover cps-and-ncmp containers when load balancinghalil.cakal2-10/+10
- remove hard-coded container names from load balancer(nginx) and prometheus Issue-ID: CPS-2437 Change-Id: Ia64b949c2eb3e4d67e123b046e66d5bfdda2c801 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-10-09Fine tune JVM parameters for cps-and-ncmphalil.cakal1-4/+2
- limit the total memory with 2G - set heap memory 75% of the total RAM Issue-ID: CPS-2180 Change-Id: Ia8a6c2bd40866052caba4f332ac563e1ed829212 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-10-09Implementation of Data validation feature in Create a Node APIArpit Singh15-39/+278
Added support to validate JSON/XML data without the need of persisting it in the databse. - added "dryRunInQuery" flag as a new query parameter - added new method as part of CpsDataService layer to perform data validation - added new method in yang parser "validateData" to validate data without persisting it Issue-ID: CPS-2361 Change-Id: I43dd33cc6120576d0fac606d5c4b0168d107311d Signed-off-by: Arpit Singh <as00745003@techmahindra.com>
2024-10-08Merge "Policy Executor: handle errors, part 2 (fighting between IntelliJ and ↵Sourabh Sourabh21-79/+235
Checkstyle best practices)"
2024-10-07Merge "Re-adjust cps expectations"Lee Anjella Macabuhay1-13/+13
2024-10-07Merge "RTD update for delta API 2"Priyank Maheshwari2-25/+41
2024-10-04Bump CPS to 3.5.4-SNAPSHOTmpriyank23-23/+51
- bump cps to 3.5.4-SNAPSHOT - updated release notes Issue-ID: CPS-2434 Change-Id: I3d5e6f37711bb29b61b598cc5af57ecfdc35cbba Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2024-10-04[CPS] Step-3: OSLO release changessourabh_sourabh1-0/+8
- cps maven stage docker yaml is created for release 3.5.3 Issue-ID:CPS-2434 Change-Id: I4048b9f54b9c0b0eb433fef9d9c403d54c39bc35 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-10-04[CPS] Step-2: OSLO release changessourabh_sourabh1-0/+4
- cps maven stage master yaml is created for release 3.5.3 Issue-ID:CPS-2434 Change-Id: I5353eb64252b3e071b5203d931f0f646ef290c13 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-10-04[CPS] OSLO release changessourabh_sourabh4-163/+254
- Updated open api for cps, ncmp and policy apis. - Updated release notes with bus and features. Issue-ID: CPS-2434 Change-Id: Ib4d80f3939b6e267f228177c817e43832a9384db Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-10-04Merge "[BUG] Fix memory leak related to using arrays in Hibernate"Lee Anjella Macabuhay9-100/+72
2024-10-04Revert "[1/2] Move Swagger API to docs folder"Lee Anjella Macabuhay12-910/+2428
This reverts commit b76392e2d1629d4eb67b10c450cdd954ef678966. Reason for revert: Release blocker Change-Id: Ic477dbaaad34992c8f440981d92f12b977cdf96e Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
2024-10-04RTD update for delta API 2Arpit Singh2-25/+41
- Documentation update for Delta Feature and Delta API 1 - Added documentation for API 2: Delta between anchor and JSON payload Issue-ID: CPS-2212 Signed-off-by: Arpit Singh <as00745003@techmahindra.com> Change-Id: Id74cd930ce48e5cb414aa62c5381b79675346a37
2024-10-03[BUG] Fix memory leak related to using arrays in Hibernatedanielhanrahan9-100/+72
The use of arrays like String[] instead of Collection<String> in JpaRepository methods is causing a memory leak, most likely due to a bug in the hypersistence-utils dependency which provides the feature. Note code using arrays in JDBC (via jdbcTemplate) is not affected. This patch removes most uses of arrays in Java, except one needed for FragmentPrefetchRepository using JDBC setArray(), which is safe. Issue-ID: CPS-2430 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I94f8c3d4c8c32ebe0978c08d3226a196a95bf3b9
2024-10-03Revert "Fix inputSpec for openapi code gen"Lee Anjella Macabuhay1-2/+2
This reverts commit 4baa75b06dcfb9365a8ea5cde03d77d7f21fa01c. Reason for revert: Release blocker Change-Id: I6156461de64dcec41e3f84cbd0cf90f63938bea6 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
2024-10-03Revert "CI: Add test (silent) checkov scan as part of the verify process"Jessica Wagantall1-151/+0
This reverts commit c8e2b3383830395bb4bc37371a9c6119a316cb53. Issue-ID: CIMAN-33 Change-Id: I5120097ad05394e3667a868c4b7edd44ef1aa070 Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
2024-10-03Policy Executor: handle errors, part 2ToineSiebelink21-79/+235
(fighting between IntelliJ and Checkstyle best practices) - non-2xx responses are processed using web client exceptions - handle unknown host exception - upgraded spotbugs (checkstyle and related mvn plugin) - fixed some small spotbugs due to upgrade - added commented instructions in docker compose to enable debugging - added some environment variables for policy executor configuration - extract out Sleeper in stub service to achieve 100% coverage - added cause to Policy Executor exceptions where applicable - ignored (new) spotbug rule about catch NPE because of issue in 3pp - ignored (new) spotbug rule about \n in string due to multiline string block Issue-ID: CPS-2412 Change-Id: I6835a73320c436cbeea12cc7a06f15899eec7bf1 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2024-10-03Added K6 script test to check a throughput of CPS kafka consumersourabh_sourabh2-0/+137
- Added new K6 script to produce cm avc enents. (It is not a part regular automated tests) - Added a json resource (avc event) Issue-ID: CPS-2329 Change-Id: I6446bc120382257c5039df17fd34b84b7c6f6550 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-10-03Re-adjust cps expectationshalil.cakal1-13/+13
- aligning cps expectation for new plots Issue-ID: CPS-2350 Change-Id: I5b300c4f5432bf2bdfe8a8b0d52b2ce60bd338d6 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-10-03Update JIRA and Wiki links host name from wiki.onap.org to lf-onap.atlassian.netsourabh_sourabh10-248/+248
Issue-ID: CPS-2432 Change-Id: I53f380a4fe0968d1ec9f1393651c7c43f03d0d95 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-09-30Merge "BugFix: 500 Server error when upgrade and service restart with data ↵Sourabh Sourabh2-1/+6
in DB"
2024-09-27Fix inputSpec for openapi code genegernug1-2/+2
Existing inputSpec only accessible from cps root. Changing path to be accessible elsewhere Issue-ID: CPS-2332 Change-Id: I94ada93ea3c88d2fdca84d49c21e1ffc2923f4b2 Signed-off-by: egernug <gerard.nugent@est.tech>
2024-09-26Merge "[1/2] Move Swagger API to docs folder"Toine Siebelink12-2428/+910
2024-09-25CI: Add test (silent) checkov scan as part of the verify processJessica Wagantall1-0/+151
Issue-ID: CIMAN-33 Change-Id: I70b171824acb913f67fd28c119bfbcbc1cc1e470 Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
2024-09-25BugFix: 500 Server error when upgrade and service restart with data in DBhalil.cakal2-1/+6
- return NONE for get effective trust level api if the trustlevel caches empty (restart case) Issue-ID: CPS-2409 Change-Id: I72a755ca6ba5d4a78f5458a235c0d1f43aaa8d53 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-09-25Merge "[k6] CM handles searches using different filters"Priyank Maheshwari4-30/+181
2024-09-25Policy Executor: handle errorsToineSiebelink10-45/+147
- configurable default answer - apply default answer upon non 2xx response - delayed default webclient read timeout - add custom timeout method with original read timeout in seconds - apply default answer upon timeout - add integration test with short timeout error scenario Issue-ID: CPS-2412 Change-Id: I62527a27e426c2f01fda2182ebd2513242c29ac1 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2024-09-24Remove Hazelcast cache for prefix resolver (CPS-2417 #2)danielhanrahan13-349/+27
This patch removes the AnchorDataCache from CPS, which is used for prefix resolution in get/query operations. As such, Hazelcast is no longer a dependency of CPS, only NCMP. - Changed PrefixResolver to be more efficient. - Removed AnchorDataCache and associated classes. - Moved HazelcastCacheConfig to NCMP. - Removed Hazelcast dependency from cps-service/pom.xml This shows good performance improvements in some APIs such as v2 GET which is nearly 2x faster (also 5x faster including base patch). Issue-ID: CPS-2417 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I24768469f24e90b70f7a6187faa4f5b3d75777d2
2024-09-24Fix intermittent error in integration testToineSiebelink1-1/+2
- make collection verification order independent Issue-ID: CPS-475 Change-Id: Ib070fd5360463c93ba6193a84a1dfcd11cd802fa Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2024-09-24Merge "Reduce anchor lookups related to PrefixResolver (CPS-2417 #1)"Toine Siebelink7-43/+46
2024-09-24Merge "Revert "Correctly report trust level if DMI is down""Daniel Hanrahan7-36/+64
2024-09-24[k6] CM handles searches using different filtersdanielhanrahan4-30/+181
Each 5 VUs for searches uses a different filter: no filter, module, property, cps path, and trust level. This is needed since each search may have different performance. This also helps reduce load versus doing a combined module and property search all the time. Issue-ID: CPS-2349 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I33a75260f97697d2061d10b80ba7eeb2f6c346f5
2024-09-24Reduce anchor lookups related to PrefixResolver (CPS-2417 #1)danielhanrahan7-43/+46
Instead of looking up same Anchor many times inside a for-loop, do it once outside the loop. This greatly improves performance in some cases, such as v2 GET API: - /cps/api/v2/dataspaces/{dataspace}/anchors/{anchor}/node Testing shows 3x faster response time. Issue-ID: CPS-2417 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I80d97d8cc24372eed70626ed840cad985cbe0a4b
2024-09-24Revert "Correctly report trust level if DMI is down"danielhanrahan7-36/+64
This reverts commit https://gerrit.onap.org/r/c/cps/+/138853 Reason for revert: Commit caused performance issues in CM handle search Manual rebase was required to integrate changes for alternate-id support made since original commit was merged. Issue-ID: CPS-2375 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I5ef743ea053589fa17c10587317a3534c2714c4b
2024-09-24Merge "Make nginx load balance using least-connections"Toine Siebelink1-1/+3
2024-09-19Retry mechanism (with back off algorithm) is removed with more frequent ↵sourabh_sourabh7-193/+115
watchdog poll - Increased watchdog frequency for locked cm handle. - Removed retry backoff algorithm for locked cm handle. Issue-ID: CPS-2395 Change-Id: I54d0ec8f9de53a7d181639c14aaaa93736f03e19 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-09-19Make nginx load balance using least-connectionsdanielhanrahan1-1/+3
By default, nginx uses round robin for load balancing. Round robin works well when all requests take same amount of time, but is not optimal for dynamic loads. With least-connected load balancing, nginx will try not to overload a busy server with excessive requests, sending requests to a less busy server instead. Issue-ID: CPS-2415 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I0e7d6b36a79aa6541f2f5f667746f2792d55e54b
2024-09-19Merge "[Cps Path Parser] Fixes for parent path & normalization"Lee Anjella Macabuhay4-46/+75
2024-09-19Merge "Change execution order of the legacy async batch read operation in k6 ↵Daniel Hanrahan1-2/+3
suite"
2024-09-18Change execution order of the legacy async batch read operation in k6 suitehalil.cakal1-2/+3
- run the test after the parallel cases - add 30 seconds safe-period of time waiting for completion of active threads (remained from previous test cases) Issue-ID: CPS-2414 Change-Id: I1260b37cd4f1974eebcccf867b36172b407a9646 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2024-09-18[1/2] Move Swagger API to docs folderegernug12-2428/+910
Code generation moved to docs folder for cps-core Issue-ID: CPS-2332 Change-Id: I9a8c5007a3039e0f46114c589de0756d6de91127 Signed-off-by: egernug <gerard.nugent@est.tech>
2024-09-18[Cps Path Parser] Fixes for parent path & normalizationdanielhanrahan4-46/+75
This commit fixes issues with Cps Path Parser related to path normalization and parent path generation when using descendant paths and ancestor axis. Issue-ID: CPS-2365 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I728fc379b134bd62c39a7085650930450c8a8597