aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2022-08-29Performance Improvement: Use hazelcast blocking queueToineSiebelink16-295/+520
- Introducing hazelcast for queue and progress map - process batch of 100 at the time - decreased module sync watchdog sleeptime to 5 seconds - separate module sync tasks in new class and some other async preparations and easier testing - tests for batching in module sync watchdog - remove qualifiers annotation (support) where no longer needed Issue-ID: CPS-1210 Issue-ID: CPS-1126 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: I0a7d3755bf774e27c5688741bddb01f427d4a8a7
2022-08-25Merge "Performance Improvement: Batch Update DataNodes"Sourabh Sourabh11-79/+245
2022-08-25Performance Improvement: Batch Update DataNodeslukegleeson11-79/+245
Implemented methods to perform a batch operation on updating datanodes Refactored replace data node(s) tree methods to update data node(s) and descendants Issue-ID: CPS-1203 Signed-off-by: lukegleeson <luke.gleeson@est.tech> Change-Id: I365d657422b19c9ce384110c9a23d041eaed06f4
2022-08-23Performance Improvement: LCM Eventsmpriyank2-8/+21
- Changed scope of method responsible for creating and publishing the LCM events. - Use a dedicated thread pool for publishing the LCM events. Issue-ID: CPS-1223 Change-Id: Ib46e3c1ff8d80f724ad9db30fca6e8125ca0775a Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2022-08-23Move Advised CM Handles Log to debug levellukegleeson1-1/+1
Issue-ID: CPS-1218 Signed-off-by: lukegleeson <luke.gleeson@est.tech> Change-Id: I77a799cfb86fe98e526519c7555bbbd85d289f04
2022-08-22Merge "Distributed datastore solution for Data Sync Watchdog"Toine Siebelink12-134/+158
2022-08-22Merge "Performance Improvement: Insert Yang Resources"Toine Siebelink4-71/+104
2022-08-22Distributed datastore solution for Data Sync Watchdogkissand12-134/+158
- update lombok config to handle Qualifier annotation - update Semaphore config to use ConcurrentMap - update SyncUtils to return a list of cm handles - update DataSyncWatchdog and ModuleSyncWatchdog with Qualifier - update DataSyncWatchdog to handle a list of cm handles - Use get with xpath to check cm handle state Issue-ID: CPS-1015 Change-Id: Icb39bd29f89e0020d49a1f8960476ffe81b12362 Signed-off-by: kissand <andras.zoltan.kiss@est.tech>
2022-08-22Merge "Performance Improvement: Retreive Yang Resources"Sourabh Sourabh4-19/+102
2022-08-22Performance Improvement: Insert Yang ResourcesToineSiebelink4-71/+104
Insert batches of yang resources for a schema set into one operation add batch-sized tests to ensure batch-size logic is covered for all branches fixed legacy issues in changed test classes Issue-ID: CPS-1208 Issue-ID: CPS-1126 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: I5b2a54ed0895999079975d777ba89d589ed4688b
2022-08-22Performance Improvement: Retreive Yang ResourcesToineSiebelink4-19/+102
Native query to more efficiently get all yangResourceIds Combined Hibernate Fragment Repository with Native impl. Issue-ID: CPS-1206 Issue-ID: CPS-1126 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: I93fbd5347dd8f9fc48d44e69e47e8aed2d7ac030
2022-08-22Merge "Performance Improvement: Detach FragmentEntities"Sourabh Sourabh1-5/+18
2022-08-22Performance Improvement: Detach FragmentEntitiesmpriyank1-5/+18
- Querying fragment entities and moving them to detached state as they are not needed to be managed by the JPA provider. - Addressed legacy change to provide actual type instead of var generic type. Issue-ID: CPS-1126 Issue-ID: CPS-1207 Change-Id: Ibbdbb197a6d480a8b2f7b9cae6052b82ea3686c6 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2022-08-22Merge "Fix: CM Handles for only hasAllModules Query"Sourabh Sourabh2-2/+2
2022-08-22Fix: CM Handles for only hasAllModules Querylukegleeson2-2/+2
hasAllModules was returning no CMHandles when queried by itself, only when paired with another query condition e.g. hasAllProperties This fix means endpoint works as expected. Reverted null check Issue-ID: CPS-977 Signed-off-by: lukegleeson <luke.gleeson@est.tech> Change-Id: Idafad4c9877941d121f5cbb98617c56a35a1cc94
2022-08-19Merge "Performance Improvement: Temporal event"Joseph Keenan4-69/+74
2022-08-19Performance Improvement: Temporal eventmpriyank4-69/+74
- Call the admin service in the async pool thread to fetch the anchor details in case of raising event on save, update and delete a node or delete list elements - Admin service is still called in the main thread in case of DeleteNodes method as we require to have anchor as we are deleting all the anchors. - Fixed the test scenarios related to processing async event - Rearranged method formal params Issue-ID: CPS-1126 Issue-ID: CPS-1209 Change-Id: Ibd8f001c4d7c7de63914f6de24042aaf01a063b2 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2022-08-19Merge "Update Cps Events LCM RTD"Joseph Keenan1-18/+1
2022-08-19Update Cps Events LCM RTDemaclee1-18/+1
Issue-ID: CPS-1196 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech> Change-Id: I6f3588e072faba5fd35bbca92990f68dd70322c8
2022-08-19Merge "Ensure Additional Properties for CM Handles are included"Joseph Keenan2-2/+13
2022-08-19Merge "Performance Improvement: Async Notification Pool Configuration"Joseph Keenan1-2/+2
2022-08-18Merge "Update info.yml for new Committer"Joseph Keenan1-0/+5
2022-08-18Merge "Performance Improvement: Tune Resttemplate"Joseph Keenan1-1/+6
2022-08-18Merge "Set Sleep Times as Environment Variable in CSIT"Joseph Keenan2-3/+6
2022-08-18Performance Improvement: Async Notification Pool ConfigurationToineSiebelink1-3/+3
Reduce threads available for notifications to allow more resources for module sync Issue-ID: CPS-1199 Issue-ID: CPS-1126 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: Iff56dd614ea0074a1b6aa08b81e324e2d0ce33c1
2022-08-18Performance Improvement: Tune Resttemplatempriyank1-1/+6
- Increase connection and read timeout for Resttemplate to a higer value Issue-ID: CPS-1201 Change-Id: Ia159b022698ff60dbd02a5877899f520b91bf883 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2022-08-18Ensure Additional Properties for CM Handles are includedToineSiebelink2-2/+13
- seems like bug is not present on master - modified test to ensure the behavior is tested now - (intelliJ) cleaned up so unused stuff Issue-ID: CPS-1212 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: I6882df4277e50ef869c6a1e9b093ee83dbcdf78e
2022-08-18Performance Improvement: Postgres Pool ConfigurationToineSiebelink1-1/+8
Issue-ID: CPS-1198 Issue-ID: CPS-1126 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: I6e1e6b28cd8e20800df61deae1826ecc2db2945e
2022-08-17Update info.yml for new Committersourabh_sourabh1-0/+5
- Updating INFO.yaml to include new committer for CPS (Sourabh) Issue-ID: CPS-1213 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech> Change-Id: If0260910ab903e0cd064ed0bbc5de79309cd1e40
2022-08-16Set Sleep Times as Environment Variable in CSITlukegleeson2-3/+6
Sleep times for Model and Data sync were being set to 2 seconds in the docker-compose file so that it may be used in CSIT tests This change defaults them to 30 seconds and adds environment variables which are overridden by the test.properties for CSIT tests Issue-ID: CPS-1195 Signed-off-by: lukegleeson <luke.gleeson@est.tech> Change-Id: Id254e3ec82fb4685fd6678d1a345b16f108b2707
2022-08-12Merge "CmHandleState transition using state handler"Toine Siebelink8-102/+111
2022-08-12Merge "Get Node API fix"Toine Siebelink2-8/+13
2022-08-11Get Node API fixputhuparambil.aditya2-8/+13
Issue-ID: CPS-1179 Signed-off-by: puthuparambil.aditya <aditya.puthuparambil@bell.ca> Change-Id: I1450ed5d05afd6dd30484eaf19b1e40fd586df8e
2022-08-11Merge "Chore: Fix typo in INFO.yaml file"Toine Siebelink1-6/+1
2022-08-10CmHandleState transition using state handlermpriyank8-102/+111
- Raise LCM Event when state transition happens. - Raised events for ADVISED to READY, ADVISED to LOCKED, LOCKED to ADVISED. - Refactor existing code to raise the events correctly. - Refactored existing test scenarios to comply with the code change. Issue-ID: CPS-1034 Change-Id: Ie548e644f6133304d7fa36c892ca2bec7393c074 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2022-08-10Merge "CSITs for DataStore SyncState"Toine Siebelink3-0/+57
2022-08-10CSITs for DataStore SyncStateemaclee3-0/+57
- add new test for dataSyncEnabled API - verify data sync follows after setting dataSyncEnabled flag Issue-ID: CPS-1168 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech> Change-Id: Ie22a6b8d6be15a05bfa3ee90218af27fe7092dd0
2022-08-10Chore: Fix typo in INFO.yaml fileBengt Thuree1-6/+1
Remove duplicate on PTL, and fix his UserID. Signed-off-by: Bengt Thuree <bthuree@linuxfoundation.org> Change-Id: I3ed42eac79e16690f930a65687fd1e88030644c8
2022-08-09Module Sync, Data Sync, Retry Mechanism RTDDylanB95EST4-4/+60
- Add Documentation for Module Sync, Data Sync, and Retry Mechanism Proccesses for RTD - Update CPS-Core header on the Index to just CPS - Add Cps-NCMP Customizations for retry mechanism and data sync Issue-ID: CPS-1181 Change-Id: Idb76de380e49e42ca337cabcf2708b940e15f46f Signed-off-by: DylanB95EST <dylan.byrne@est.tech>
2022-08-08Merge "Rename name column in yang resource table"Joseph Keenan11-19/+30
2022-08-08Merge "Upgrade Postgres Cps-Core"Joseph Keenan2-2/+3
2022-08-05Rename name column in yang resource tableDylanB95EST11-19/+30
- Rename name column in yang_resource table to file_name - Refactor instances where it occures in code and tests - Add new changelog file to rename occurance Issue-ID: CPS-529 Change-Id: I2aff97410bdb041b90d8ceaeff75e562ef8d9238 Signed-off-by: DylanB95EST <dylan.byrne@est.tech>
2022-08-05Upgrade Postgres Cps-CoreDylanB95EST2-2/+3
Upgrade postgres version to 14 in accordance with Seccom Issue-ID: CPS-897 Change-Id: I332c88f3c3e1ec3dd55afe31af5714b690b6bd07 Signed-off-by: DylanB95EST <dylan.byrne@est.tech>
2022-08-05State Model RTDDylanB95EST1-0/+14
Add Read The Doc documentation for CM-Handle state model Briefly explain all 5 potnetial cm handle states Issue-ID: CPS-1162 Change-Id: Iee52f9c280929337abf4aac2f5c9bbfb1edde30f Signed-off-by: DylanB95EST <dylan.byrne@est.tech>
2022-08-04Document DataStore Sync State(RTD)bmiklos1-0/+10
Added a CM-Handle data sync state description section under Cps-Modelling -> NCMP-Modelling -> Basic Concepts -> Cm Handle Issue-ID: CPS-1164 Change-Id: Ia53a1ccbacda388ec98a3de936af0913edad1c58 Signed-off-by: bmiklos <miklos.baranyak@est.tech>
2022-08-04Merge "Query CM Handles RTD"Joseph Keenan7-52/+299
2022-08-04Query CM Handles RTDlukegleeson7-52/+299
Updates to RTD for CM Handles Querying Removed documented limitation in CPS path which has since been implemeneted Updated dmi-registry file in RTD modeling Issue-ID: CPS-1161 Signed-off-by: lukegleeson <luke.gleeson@est.tech> Change-Id: I19ff09dadb43a46e14844e198278949f059c6e68
2022-08-04LcmEvent state handler refactoringmpriyank9-38/+475
- State handler will now handle new structure of LcmEvent. - We have 3 types of events i.e create, update and delete. - Introduced the LcmEventCreatorHelper to delegate some of the responsibility of event creation based on event type and the state. - New tests and existing refactoring - Code rebased - Refactored name as per group code review - Code rebase with other commits - Used copy constructor for deep copy operation of NcmpServiceCmhandle and CompositeState - UPCOMING : Related user stories to trigger the event publishing using state handler. Issue-ID: CPS-1128 Change-Id: I94b5a87d37d6a174c017ee0aa37cd0f0f74ba084 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2022-08-02Merge "Enable/Disable Data Sync for Cm Handle"Joseph Keenan20-58/+230
2022-08-02Merge "Incorrect response to {} for cmhandle id-searches"Joseph Keenan2-3/+3