summaryrefslogtreecommitdiffstats
path: root/cps-application/src
AgeCommit message (Collapse)AuthorFilesLines
2022-09-01Performance Improvement: Watchdog Parallel execution with configurationsourabh_sourabh1-0/+4
- Introduced AsyncSyncExecutor to get task and execute it with configured number of parallel threads. - Number of parallel thread can be configured from application.yml. - AsyncTaskExecutorSpec is added - Fixed existing grovvy test now async task would be submitted. Issue-ID: CPS-1200 Change-Id: I58c0368b945c90e619c2acfc7458ba58de047484 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2022-08-29Performance Improvement: Use hazelcast blocking queueToineSiebelink1-1/+1
- Introducing hazelcast for queue and progress map - process batch of 100 at the time - decreased module sync watchdog sleeptime to 5 seconds - separate module sync tasks in new class and some other async preparations and easier testing - tests for batching in module sync watchdog - remove qualifiers annotation (support) where no longer needed Issue-ID: CPS-1210 Issue-ID: CPS-1126 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: I0a7d3755bf774e27c5688741bddb01f427d4a8a7
2022-08-19Merge "Performance Improvement: Async Notification Pool Configuration"Joseph Keenan1-2/+2
2022-08-18Performance Improvement: Async Notification Pool ConfigurationToineSiebelink1-3/+3
Reduce threads available for notifications to allow more resources for module sync Issue-ID: CPS-1199 Issue-ID: CPS-1126 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: Iff56dd614ea0074a1b6aa08b81e324e2d0ce33c1
2022-08-18Performance Improvement: Postgres Pool ConfigurationToineSiebelink1-1/+8
Issue-ID: CPS-1198 Issue-ID: CPS-1126 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Change-Id: I6e1e6b28cd8e20800df61deae1826ecc2db2945e
2022-07-28Enable/Disable Data Sync for Cm HandleDylanB95EST1-5/+1
-Create API Which will enable/disable data sync enabled flag -Default functionality of module sync watchdog is to set to false -Remove global config param -Will set initial sync state based on data sync enabled flag -Throws an Exception if the same data sync enabled flag tries to be set -Throws Exception if state is not in READY -Data Sync enabled must be true to complete data sync process - Delete all resource data within fragment table related to synced cm handle when data sync is set to false Issue-ID: CPS-1133 Change-Id: Ib47bbd8293f083c1d705d91bd0def74e6a105c72 Signed-off-by: DylanB95EST <dylan.byrne@est.tech>
2022-07-25CmHandle creation performance degradationsourabh_sourabh1-2/+2
- Created a dedicated threadpool for scheduler. - Tuned async threadpool of notification executor from setting RejectedExecutionHandler and application.yml. Issue-ID: CPS-1126 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech> Change-Id: I2afe3c76c1aec78751777df0d2f08ddb8dcee102
2022-07-14Code Refactoring Ncmp* to Lcm* as per new scopempriyank1-1/+2
- Refactored code to reflect the LcmEvents scope now. - Test cases updated and dependencies reviewed. - You can find few occurences of NcmpEvent for now but that will be cleaned up once we implement CPS-1104 which is for LcmEvent schema - UPCOMING: LcmEvent schema and then the code to publish the events on cmHandleStates - LATER : LcmEvents based on public properties update. Issue-ID: CPS-1137 Change-Id: I9f395ed733b4028e706205894c36a38412e3452e Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2022-07-07Define Initial Data Sync Enabled Flag and stateDylanB95EST1-0/+4
- Define the initial Data Sync Cache enabled through configuration parameter - Set the data sync enabled flag based on this - And in turn define the initial sync state of the Data Sync Issue-ID: CPS-1119 Change-Id: I43bf03c79481291bf47c9b672f7bf408d789df61 Signed-off-by: DylanB95EST <dylan.byrne@est.tech>
2022-06-30Composite state transition code changesourabh_sourabh1-0/+2
- Code cannge to set datastore to Unsynchronized when state moves from advice to ready - if resource data is not available or there is any issue while reading data from simulator then state will be set to synchronized else remain unsynchronized. - Handle serialization failure on empty bean. Issue-ID: CPS-1000 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech> Change-Id: Ie51a787770da649e00aaefc00341756f92f9fa83
2022-06-30Kafka consumer can not be turned offJosephKeenan1-2/+2
-NOTE: Build will fail until docker-compose version issues on build server are fixed --Ticket raised https://jira.linuxfoundation.org/plugins/servlet/theme/portal/2/IT-24219 -added flag for async -added response if async is triggered without being enabled & associated test -modified to use one global flag for notifications Issue-ID: CPS-1088 Signed-off-by: JosephKeenan <joseph.keenan@est.tech> Change-Id: If9d988b4dcb71bf37c1b1bf9464090782708ffc2
2022-06-22Data Sync Watchdog Processsourabh_sourabh1-2/+3
- Get all the Cm Handles state in READY and Operational datastores sync state in UNSYNCHRONIZED - Get a random Cm Handle - Get the first resource data from the node - Save the data in Cps Db - Update the Operational datastores sync state to SYNCHRONIZED Issue-ID: CPS-1052 Issue-ID: CPS-1053 Issue-ID: CPS-1054 Change-Id: I9a20391ef30e6d56c4d789a92b8bf42cd3756c62 Signed-off-by: Lathish <lathishbabu.ganesan@est.tech> Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2022-06-15Retry CM-Handles that are LOCKED, Failed-to-Syncputhuparambil.aditya1-2/+5
Watchdog added to fetched locked cm handles by Lock reason and operation sync state Tests updated Issue-ID: CPS-878 Signed-off-by: puthuparambil.aditya <aditya.puthuparambil@bell.ca> Change-Id: I0ecc519e93b097ec3d309db7f686fb23a0fc59b2
2022-06-07Ncmp Producer Setupmpriyank1-1/+2
- Ncmp Kafka Publisher setup - Test scenarios - Refactored existing test class which were using kafka producer and consumer properties to use from common MessageSpec - Upcoming : Implementation Proposal and Actual logic to publish the correct event Issue-ID: CPS-1035 Change-Id: I93ae392e8c4e4c85d88ca7858332e79b59e85535 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2022-06-02CPS-1020 : DuplicatedYangResourceException error at parallel cmHandle ↵sourabh_sourabh1-0/+2
registration - @EnableRetry is added into application. - Added retry count into log to add more information about retry. Issue-ID: CPS-1020 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech> Change-Id: I00c58ef17a8c066f98711c1cf8e5e5cb5f22974b
2022-06-01Fixing CompositeState mappingmpriyank1-0/+3
- Mapper null check - NcmpServiceCmHandle mapping for the new composite state - Added global parameter for jackson to include only NON_NULL attributes in the response Issue-ID: CPS-1066 Change-Id: I1924fef45345c77873f9c788baa701311e72bea7 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2022-05-25Async request response NCMP -> ClientJosephKeenan1-1/+14
-Added consumer for DMI events and producer for forwarding to client -Added schemas for events -Updated tests -Added new module for ncmp events -Used mapstruct for event mapping Issue-ID: CPS-830 Change-Id: I096d08af9d69092cf8651e11eaa00ce441fc3605 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech> Signed-off-by: JosephKeenan <joseph.keenan@est.tech> Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Signed-off-by: JosephKeenan <joseph.keenan@est.tech>
2022-05-16Remove NCMP tag from propertiesDylanB95EST1-10/+11
We have decided to remove the NCMP tag from properties and will add it later as part of our release process for KOHN. Issue-ID: CPS-875 Change-Id: I7282c3c11879f2252c8a1b193df17f3f4bb1cf14 Signed-off-by: DylanB95EST <dylan.byrne@est.tech>
2022-05-10Watchdog Process-Make ConfigurableDylanB95EST1-0/+3
Make time configurable for the watchdog process. Add documentation outlining this. Issue-ID: CPS-875 Change-Id: I1307c82d02789097efda1ba981eb1fd36c9efc38 Signed-off-by: DylanB95EST <dylan.byrne@est.tech>
2022-05-09Add ncmp tag to application yamlDylanB95EST1-7/+7
Add an NCMP tag to Application.yml to store NCMP related propeties Issue-ID: CPS-875 Change-Id: I2bce3d765ae69cc2a4bb52a472eea7cae745fd2c Signed-off-by: DylanB95EST <dylan.byrne@est.tech>
2022-05-05Security Logging Fieldssourabh_sourabh1-0/+1
- logback core and encoder dependencies are added. - New appender is added to log JSON format content on console. Issue-ID: CPS-986 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech> Change-Id: Ia72b27f306019fa259b3d6de4c5399f0ae734076
2022-03-10Async: NCMP Rest impl. including Request ID generationsourabh_sourabh1-1/+1
- Based on topic api can be sync or async - RequestId is generated using UUID - Used UriComponentBuilder to populate dmi service url. - New test cases are introduced to validate service url generation. Issue-ID: CPS-828 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech> Change-Id: I2696d5cb012d9274b0c1265f16aa9b2369657f05
2022-02-02Merge "[TECHDEBT] Align CPS Core REST API Specification and Implementation"aditya puthuparambil1-2/+3
2022-01-31[TECHDEBT] Align CPS Core REST API Specification and ImplementationJosephKeenan1-2/+3
Issue-ID: CPS-822 Signed-off-by: JosephKeenan <joseph.keenan@est.tech> Change-Id: Idde7525628f7e1425602069e0d75506ac621113e
2022-01-28Database port not configurable through env variableputhuparambil.aditya1-1/+1
Issue-ID: CPS-867 Signed-off-by: puthuparambil.aditya <aditya.puthuparambil@bell.ca> Change-Id: I1f5e00c6b814a5ba087ba0cc1832152b2317ad57
2022-01-25Improve logging in NCMPsourabh_sourabh1-1/+5
Issue-ID: CPS-855 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech> Change-Id: I5d8a6a711d1c6b13d5d8eeba52a1dcd689dbdae2
2021-11-25Allow separate registration of DMIDataPlugin and DmiModelPuginJosephKeenan1-0/+2
Moved relevant code from NetworkCmProxyDataServiceImp to DmiOperations Split DmiOperations into DMiData... and DMIModelOperations Merged update-operation changes Added tests for error message validation in NetworkCmProxyDataServiceImplSpec Removede @Service from DMIOperations and added @component to DmiDataOperations & DmiModelOperations Verify sync robot test is now hardened Added exitonfailure so robot tests stop after first encountered failed test Issue-ID: CPS-736 Change-Id: I0b40931cc8cd4fc0452328a0a7e0f60e6fc38d0a Signed-off-by: JosephKeenan <joseph.keenan@est.tech> Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Signed-off-by: DylanB95EST <dylan.byrne@est.tech>
2021-10-07Separate ncmp south-bound endpoints in openapi specsRenu Kumari1-1/+5
- existing ncmp-cps swagger ui shows only northbound endpoints - added cps-ncmp-internal for southbound endpoints Issue-ID: CPS-722 Signed-off-by: Renu Kumari <renu.kumari@bell.ca> Change-Id: I6917a9c1cf6d033f7ed76f2172113d5e43ac84a7
2021-09-02Add property to enable Notification Sevice async processingRenu Kumari1-6/+8
- made notification service synchronous by default - added new property to enable async processing if required Issue-ID: CPS-630 Signed-off-by: Renu Kumari <renu.kumari@bell.ca> Change-Id: I28c2c98d7a79219a5932732d2940f5ac37bf1653
2021-09-01Add ncmp endpoints to swagger-uiRenu Kumari1-4/+9
- added ncmp-enpoints to swagger-ui - removed springfox dependencies - removed Docket configuration as we are loading ui from openapi.yml - removed endpoints which are not implemented - Fixed ncmp basepath as per CPS-616 Issue-ID: CPS-601 Issue-ID: CPS-616 Signed-off-by: Renu Kumari <renu.kumari@bell.ca> Change-Id: I03c7789f48a12d3ffd5fcb934d7ba6347d4044e4
2021-08-26Post impl for passthrough running (Ncmp impl.)tragait1-1/+2
Issue-ID: CPS-577 Signed-off-by: tragait <rahul.tyagi@est.tech> Change-Id: Ic8983349cf88fb123feb95ce01ec6fdf670469f4
2021-08-25Merge "Process data-updated event asynchronously"Toine Siebelink2-2/+9
2021-08-24Prepare for next event schema versionmr/584/123451/3Bruno Sakoto1-1/+1
Issue-ID: CPS-584, CPS-459 Signed-off-by: Bruno Sakoto <bruno.sakoto@bell.ca> Change-Id: Iaf605492783f8c06f40522a427ce63bd2d1b34d0
2021-08-24Process data-updated event asynchronouslyRenu Kumari2-2/+9
- notification is processed asynchronously using defined threadpool - updated docker-compose and readme to add dataspace filtering variables Issue-ID: CPS-526 Signed-off-by: Renu Kumari <renu.kumari@bell.ca> Change-Id: I7f827250f45cb9e3db2f060e9b3a089a4eaee05c
2021-08-20Merge "get resource data for operational passthrough"Niamh Core1-0/+5
2021-08-19get resource data for operational passthroughtragait1-0/+5
Issue-ID: CPS-487 Signed-off-by: tragait <rahul.tyagi@est.tech> Change-Id: Id1b761f3f6a388556d0cc334fd6f196c78badc39
2021-08-17Filter data updated events based on configured patternRenu Kumari1-1/+3
Issue-ID: CPS-469 Signed-off-by: Renu Kumari <renu.kumari@bell.ca> Change-Id: I7810990b54c3140677184ea671164b8835a6afbb
2021-07-16CPS-401 Update Open API YAML with data types and example for output (cpsData)JosephKeenan1-0/+5
-added response for get data nodes based on dataspace and anchor -modified modelmapper jn DataRestControllerSpec to be Spy not Mock -when openapi.yaml is entered into https://editor.swagger.io/ it displays however locally it does not, This may be due to file segmentation but this is still unclear. -moved files from docs/openapi to src/main/resources/static as required for new swagger sprindoc Issue-ID: CPS-401 Change-Id: I45286530d9a9ca85b56c0a656a44675398a003f4 Signed-off-by: JosephKeenan <joseph.keenan@est.tech>
2021-07-15Merge "Expose Prometheus metrics for monitoring"Toine Siebelink1-5/+5
2021-07-14Expose Prometheus metrics for monitoringputhuparambil.aditya1-5/+5
Issue-ID: CPS-492 Signed-off-by: puthuparambil.aditya <aditya.puthuparambil@bell.ca> Change-Id: I264066bd543daf2a45f2ec9a6b8cdf8012927828
2021-07-13Editing of Nordix Licenses to ONAP guidelineslukegleeson2-5/+7
Issue-ID: CPS-489 Signed-off-by: lukegleeson <luke.gleeson@est.tech> Change-Id: I415534515b3d8325f41d5dc1d02c6e0ae70c6cf1
2021-07-07Merge "Sending Data Updated Event to kafka"Toine Siebelink1-0/+14
2021-07-07Sending Data Updated Event to kafkaRenu Kumari1-0/+14
Issue-ID: CPS-374 Signed-off-by: Renu Kumari <renu.kumari@bell.ca> Change-Id: I05fedcace42b84575411df26c586788bffe6b846
2021-07-06Adding Layered Architecture test and Arch Unit Library for CPS-COREDylanB95EST2-0/+79
Adding Layered Architecture Test Will Add Depedency Test at later time after potential refactoring of project structure Adding Archunit property file to avoid Store Initialization Exception Issue-ID: CPS-380 Change-Id: I364294a46b1ab78b86a9c271856805fce09f75a0 Signed-off-by: DylanB95EST <dylan.byrne@est.tech>
2021-06-18Missing licence info added in pom fileshivasubedi1-0/+17
- Added licence info to files that were missing it - Fixed licence info to match with the creator of the file Issue-ID: CPS-467 Signed-off-by: shivasubedi <shiva.subedi@est.tech> Change-Id: I1c0eaedb2c87743a61a1cd58f33b0d0d04b3a977
2021-04-15Remove default password from application.ymlRenu Kumari1-2/+2
Issue-ID: CPS-319 Signed-off-by: Renu Kumari <renu.kumari@bell.ca> Change-Id: I61a5e098ffa173721cfa48aa0b992610f6a6e1a0
2021-04-07Merge "Fix upload size to be greater than 1MB"Bruno Sakoto1-0/+6
2021-04-07Fix upload size to be greater than 1MBniamhcore1-0/+6
Issue-ID: CPS-308 Signed-off-by: niamhcore <niamh.core@est.tech> Change-Id: I1de6efa882f85cf6f9054e3ef38ed6e0bd99d7be
2021-04-07Merge "Fix security hotspots n Regex"Bruno Sakoto1-1/+1
2021-04-06Moved application.yml under cps-applicationRenu Kumari1-0/+80
Issue-ID: CPS-248 Signed-off-by: Renu Kumari <renu.kumari@bell.ca> Change-Id: Ibfe68684784a9bd38e9e1e5d6a5e7909c4c11909