summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2023-02-16Improve batch delete schemasets performancedanielhanrahan17-29/+221
- Bulk delete anchors and datanodes associated with schemasets. Improves de-registration performance by approx 10% Issue-ID: CPS-1423 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ie38e8b4c64356bf5935d8c7a5d3f5bfa73fb1714
2023-02-15Bulk delete schemasets in CM handle deregistrationdanielhanrahan15-19/+162
- Batch delete schema sets in single query - Call deleteUnusedYangResourceModules once per batch, not per CM handle - Results for deregistering 10k: 14 mins before; 6 mins after Issue-ID: CPS-1423 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ia3a86a0dc88677323e2f386253a99022a7f02603
2023-02-15Merge "Use getDataNodes (plural version) into NCMP to get CM handles ↵Toine Siebelink5-114/+42
Performance improvement"
2023-02-15Introducing GrafanaToineSiebelink3-5/+60
- Added profiles to docker compose: dmi-service/dmi-stub, monitoring - NOTE: now need to add '--profile dmi-service' to enable dm-plugin (e.g. for csit) - using container names to resolve hosts for prometheus Issue-ID: CPS-1465 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: I5d7365a3f789cc698e2702d72700a002cf03eaef
2023-02-14Use getDataNodes (plural version) into NCMP to get CM handles Performance ↵seanbeirne5-114/+42
improvement - Code clean-up on existing classes - Removed duplicate code Issue-ID: CPS-1426 Signed-off-by: seanbeirne <sean.beirne@est.tech> Change-Id: I3e2ce5b804d7a6e87838490d970cde3cd563f06b
2023-02-13Merge "Test for yang file archive limitation"Luke Gleeson5-38/+72
2023-02-13Merge "Generate report of Instrumentation Metrics"Toine Siebelink2-1/+112
2023-02-13Test for yang file archive limitationhalil.cakal5-38/+72
- add new test - fixed misleading method names Issue-ID: CPS-1480 Change-Id: I9dd8f41d0acfc8b1c063aab65567d619670f4905 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2023-02-11Generate report of Instrumentation Metricsdanielhanrahan2-1/+112
Generate a tab-seperated-value report of Prometheus metrics. By default, assume CPS/NCMP is running on localhost:8887, and output file named metrics-YYYY-MM-DDThh:mm:ss+00:00.tsv Issue-ID: CPS-1488 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I8bb356a1b6caacaec4a025a7d6d29cd34420e6c9
2023-02-09Use getDataNodes (plural) in CmHandle deregistrationdanielhanrahan2-24/+19
Issue-ID: CPS-1426 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I0ad79bf36840cdecc13898e185dc618cedafd529
2023-02-09Merge "Produce subscription create event for subscription-topic: ↵Toine Siebelink4-4/+119
cm-avc-subscription"
2023-02-09Merge "Update CmHandleState on deregistration response"Priyank Maheshwari2-46/+75
2023-02-09Produce subscription create event for subscription-topic: cm-avc-subscriptionsourabh_sourabh4-4/+119
- Groovy Kafka (component level) : Produce subscription create event. Issue-ID: CPS-1394 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech> Change-Id: Ib020c0a4458406925792fc074afd998aa09af158 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2023-02-08Merge "Correct calculation of zip archive size for schemaset upload"Toine Siebelink1-1/+1
2023-02-08Use getDataNodes (plural version) into NCMP to get CM handlessourabh_sourabh6-12/+225
- Use plural getYangModelCmHandles get YangModelCmHandles by CmHandles in batches. Issue-ID: CPS-1426 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech> Change-Id: Ie175b471bd98b02b572ca4a3ff699d721b5b782a Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2023-02-08Release Process Step 7mpriyank20-21/+50
- updated pom to 3.2.3-SNAPSHOT - updated version.properties and updated the release notes to properly depict the correct version Issue-ID: CPS-1476 Change-Id: Ied60194c6dd4153b58a43715cb729ad75b8e12bf Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2023-02-08Release Step 6mpriyank1-0/+8
- adding container yaml file for the release Issue-ID: CPS-1476 Change-Id: Ib61a14591b9fe62e96d24ae3c557f720a23217c7 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2023-02-08Release process Step 4mpriyank1-0/+4
- adding maven stage yaml file Issue-ID: CPS-1476 Change-Id: Iafbc5ed63cf4edc275e5b4087c154439c5c5ac55 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2023-02-08Release Steps 1 and 2mpriyank2-5/+11
- added the jira ticket as part of step1 - copied the changes of openapi.yaml as part of step2 of release process Issue-ID: CPS-1476 Change-Id: I877757e0396e6349b1ab5e966ae4440c4fead829 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2023-02-08Correct calculation of zip archive size for schemaset uploadArne Chrestin1-1/+1
Correct calculation of zip archive size for schemaset upload Issue-ID: CPS-1477 Change-Id: I73f97f986a817d423f93a8d922dcd9647b0203ab Signed-off-by: Arne Chrestin <arne.chrestin@telekom.de>
2023-02-07Update CmHandleState on deregistration responsedanielhanrahan2-46/+75
Current implementation incorrectly sets CmHandleState to DELETED for CM handles that were not deleted. - Update CmHandleState to DELETED only for deleted CM handles - Minor test refactoring Issue-ID: CPS-1471 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ibf8b6d2b87d46a7633f0497b065e3d4099851fd6
2023-02-03Merge "Descendants description changed in openApi"Luke Gleeson2-4/+3
2023-02-03Descendants description changed in openApirajesh.kumar2-4/+3
Issue-ID: CPS-1381 Change-ID: I73f97f986a817d423f93a8d922dcd9647b0203aa Signed-off-by: rajesh.kumar <rk00747546@techmahindra.com>
2023-02-02CmHandle batch deletiondanielhanrahan5-29/+79
- Use plural deleteDataNodes to remove CmHandles in batches, falling back to individual delete on error - Use single deleteDataNode instead of deleteListOrListElement for individual delete Issue-ID: CPS-1464 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: If09f22478df8703290c8fc24aa6fe2a11c90788a
2023-02-02Modify CSIT script to have absolute root path envemaclee4-6/+6
- change set up to call docker compose for cps-ncmp - add root as a property in 'test.properties' - root is specified to be root directory folder for the current project - modified docker compose init container to use ROOT env var Issue-ID: CPS-1472 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech> Change-Id: Ie5ac6bbff7cb1e761501bd0db8447f86af06b95f
2023-02-01Create plural version of deleteDataNodedanielhanrahan14-104/+315
- Add method to CpsDataService to batch delete data nodes and lists - Use native queries to batch delete fragment entities by xpaths, for data nodes and lists - Add performance tests for batch delete - Refactor FragmentNativeRepository - Add single-column version of createTemporaryTable - Renamed metric cps.data.service.datanode.batch.delete to cps.data.service.datanode.all.delete Issue-ID: CPS-1438 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I1851f9c7ef0b1be4bd421b3352d9697a2dd23f79
2023-01-31Merge "Introduce Instrumentation"Luke Gleeson27-115/+431
2023-01-31Introduce InstrumentationToineSiebelink27-115/+431
- Add instrumentation related dependency - Added Timed Instrumentation - CPS-Service Crud methods - CPS Yang parsing - NCMP Registration methods - NCMP Events handling - Remove manual Gauge for YanResources Cache as (better!) instrumentation is already built into the 3PP - Sorted dependecies alphabetically (as we used to enforce, to prevent duplicates) - Added ## P E R F O R M A N C E T E S T R E S U L T S ### mini report - (unrelated) test improvement (because of bug that turned out to be invalid) Reviewers: Sourabh,Priyank, Luke Issue-ID: CPS-1457 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: I34b20bece2f59488b022b8effa9470704c57be4d
2023-01-30Edit example given for ncmp datastoreseanbeirne2-7/+7
Issue-ID: CPS-1468 Signed-off-by: seanbeirne <sean.beirne@est.tech> Change-Id: Id746604fca83333f4ee186ce96ea80cb779c4ac2
2023-01-30Fix for integration test module testslukegleeson2-26/+6
Added Fragment Native Repository to test config Removed test profile Issue-ID: CPS-1466 Signed-off-by: lukegleeson <luke.gleeson@est.tech> Change-Id: Id845b713e760801be480aa9aea6cb304decd05b9
2023-01-27Update version files for release processseanbeirne20-19/+43
- Updated version.properties - Updated release-notes - Updated pom files Issue-ID: CPS-1835 Signed-off-by: seanbeirne <sean.beirne@est.tech> Change-Id: I0f837ac41d24b41d7c2b9e3dfe2dacc550c0aafa
2023-01-27Create release container yaml file for release processseanbeirne1-0/+8
Issue-ID: CPS-1385 Signed-off-by: seanbeirne <sean.beirne@est.tech> Change-Id: I95f3f76c49ea9eb9556fb4b32dbe10dc3e8283ad
2023-01-27Merge "Create release yaml file for release process"Priyank Maheshwari1-0/+4
2023-01-27Merge "Release Note Update"Sourabh Sourabh1-8/+23
2023-01-27Release Note Updatelukegleeson1-8/+23
Added Query large outputs using limit/depth/pagination Reordered existing items in ascending Jira number order Added missing Jiras Issue-ID: CPS-1381 Signed-off-by: lukegleeson <luke.gleeson@est.tech> Change-Id: I1a124db8d8a4adffc7807aecddb378876b732cd7
2023-01-27Create release yaml file for release processseanbeirne1-0/+4
Issue-ID: CPS-1385 Signed-off-by: seanbeirne <sean.beirne@est.tech> Change-Id: I98c7cafb3b850ef6a419c87c242e1f469ccf600e
2023-01-27Merge "Define and onboard model for subscription events"Luke Gleeson4-1/+127
2023-01-27Define and onboard model for subscription eventsemaclee4-1/+127
- created new yang model for subscription events; added in ncmp-service - created new container/service to run an init container - added script file to the container - added Dockerfile to be the base image of the init container - health check for CPS added as part of script - removed previous patch modification in setup - changed path of models and dockerfile to main project - latest patch: changed connection to external ports of CPS Issue-ID: CPS-1393 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech> Change-Id: I2367020e57b34a669dda93050eeaeede5846304e
2023-01-26Merge "NCMP De-Register response payload and status is invalid"Sourabh Sourabh1-10/+9
2023-01-26Merge "Disable persistence integration tests"Toine Siebelink1-46/+72
2023-01-26Disable persistence integration testslukegleeson1-46/+72
Disable tests for deploy Enable tests in Nordix jobs Issue-ID: CPS-1466 Signed-off-by: lukegleeson <luke.gleeson@est.tech> Change-Id: I2aa4952ea800d3499ea7380faefdcac1d8955cb4
2023-01-26NCMP De-Register response payload and status is invalidsourabh_sourabh1-10/+9
-Refactored "DELETING" and "DELETED" update state to avoid wrong response code. Issue-ID: CPS-1463 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech> Change-Id: I639ba94986c4ffe48d2d42f14f6a6b4e2bd2713e Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2023-01-26Merge "Springboot Integration tests improvements"Sourabh Sourabh12-2/+1219
2023-01-26Update openAPI documentation for release processseanbeirne3-1150/+1515
Issue-ID: CPS-1385 Signed-off-by: seanbeirne <sean.beirne@est.tech> Change-Id: Ia0b011d4497e7d95f9b625514e8b3216575df044
2023-01-25Springboot Integration tests improvementslukegleeson12-2/+1219
Creation of CpsIntegrationSpecBase Demonstration of test class implementing CpsIntegrationSpecBase in CpsPersistenceSpec Tests use reduced liquibase steps, basic bookstore yang model and bookstore json payload Issue-ID: CPS-1379 Signed-off-by: lukegleeson <luke.gleeson@est.tech> Change-Id: I38202d0888808d08d85fce1aab45fc43e8b0cec3
2023-01-24Merge "Update INFO.yaml Committers"Toine Siebelink1-10/+10
2023-01-24Update INFO.yaml Committerslukegleeson1-10/+10
Issue-ID: CPS-1462 Signed-off-by: lukegleeson <luke.gleeson@est.tech> Change-Id: I0b5bd7baffc03ae8c91a73926c4fa7596dba1a96
2023-01-24Handle root xpaths in getDataNodesdanielhanrahan3-6/+19
Issue-ID: CPS-1458 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I64abf97317afe4335c8d04169689ee1396e75860
2023-01-24Merge "Use native query to delete data nodes"Toine Siebelink6-13/+110
2023-01-23Use native query to delete data nodessourabh_sourabh6-13/+110
- Used hashcode to remove child fragment based on it's xpath - Used native query to delete fragment by altering fragment_parent_id_fkey CONSTRAINT. Issue-ID: CPS-1439 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech> Change-Id: If19c449818e18f8fd666503b7346704eeb4a95d0 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>