aboutsummaryrefslogtreecommitdiffstats
path: root/cps-ncmp-service/src
AgeCommit message (Collapse)AuthorFilesLines
3 daysMerge "Fix NullPointerException for cm handle state metrics"Toine Siebelink3-1/+192
3 daysMerge "Refactor Consumers/Producers based on agreed format"Priyank Maheshwari12-57/+56
3 daysMerge "Use Flux stream processing for CM-handle searches"Toine Siebelink6-48/+46
4 daysAdd CloudEventBuilder to SpringBootTestegernug2-2/+4
There are test failures on: DmiInEventProducerSpec NcmpOutEventProducerSpec stemming from CloudEventBuilder being missing from the SpringBootTest. Adding this to clear issues. Issue-ID: CPS-2727 Change-Id: I5e838741d7fc54bc91c5d91497085da68ab391d4 Signed-off-by: egernug <gerard.nugent@est.tech>
4 daysFix NullPointerException for cm handle state metricshalil.cakal3-1/+192
- ensure the certain beans are created in a specific order: 1-AdminCacheConfig 2-CmHandleStateMonitor 3-CmHandleStateConfig - extract cm handle state config from MicroMeterRegistry to allow control order of bean initialization to prevent NullPointerException - introduce @DependsOn annotation Issue-ID: CPS-2677 Change-Id: I8dfec54cc7e603bded6a24e7362437042b222fd3 Signed-off-by: halil.cakal <halil.cakal@est.tech>
4 daysMerge "Remove private properties from DMI write operations"Toine Siebelink3-13/+7
4 daysUse Flux stream processing for CM-handle searchesdanielhanrahan6-50/+48
This greatly reduces memory consumption to fetch CM-handles in NCMP by fetching in batches in a Flux. Full CM-handle search operations now consume much less memory than before. The lower memory usage and database pressure improves overall performance. Issue-ID: CPS-2712 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I7f653fadeadbf9612e0847f9451654b01a1a5604
5 daysUse attribute-axis in NCMP [#4]emaclee5-20/+61
- introduce getCmHandleReferencesByCpsPath for queries by cps path in replacement for use of 'queryCmHandleAncestorsByCpsPath' Issue-ID: CPS-2666 Change-Id: I38b76e1f255ad1751b13f6a22dbcf540fed764bd Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
5 daysRefactor Consumers/Producers based on agreed formatemaclee12-57/+56
- agreed: consumer over producer - agreed: 'Consumer' is named based on what it consumes - agreed: no 'Publisher' in names, use producer instead - AsyncRestRequestResponseEventConsumer to DmiAsyncRequestResponseEventConsumer - LcmEventsService to LcmEventsProducer - CmAvcEventPublisher to InventoryEventProducer - CpsDataUpdateEventsService to CpsDataUpdateEventsProducer - see https://lf-onap.atlassian.net/wiki/spaces/DW/pages/16514237/CPS+Data+Notifications+Overview?force_transition=43836314-5d80-4b83-b9f4-7880332d79a4 for more info Issue-ID: CPS-2597 Change-Id: Iaafb435fcf985372d4858bcbbcd98901ac778b52 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
6 daysRemove private properties from DMI write operationssourabh_sourabh3-13/+7
Issue-ID: CPS-2693 Change-Id: Ibef6a3bed095bc668d07324bf7cf011fdb01da09 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
9 daysMerge "Implemented parallel execution for writeDataJob using ExecutorService ↵Daniel Hanrahan1-2/+2
with 10 concurrent threads"
9 daysMerge "Use attribute-axis in NCMP [#3]"Daniel Hanrahan5-22/+69
9 daysImplemented parallel execution for writeDataJob using ExecutorService with ↵sourabh_sourabh1-2/+2
10 concurrent threads Issue-ID: CPS-2692 Change-Id: I497e2e626e60b08c6cf28ffa94884808d68a1dd9 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
10 daysUse attribute-axis in NCMP [#3]emaclee5-22/+69
- uses queryleaf API on the methods 'getCmHandleReferences' Issue-ID: CPS-2664 Change-Id: I7552b4cdfcfa5eb285b94c1dcebfa5ba8327508c Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
11 daysEnhance batch operation performance with AlternateIdMatcherleventecsanyi6-41/+12
- used more efficient methos in AlternateIdMatcher to get cmHandleIds - removed getYangModelCmHandlesFromCmHandleReferences from InventoryPersistence class (unused + bad performance) Issue-ID: CPS-2607 Change-Id: Ia1970435aec57cd12713958a910a9ced4511440b Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
2025-03-13Merge "Optimize Hazelcast usage in Trust Level Search"Priyank Maheshwari2-9/+11
2025-03-13Batch fetch all CM-handles for faster data jobsourabh_sourabh6-60/+86
This optimizes the write data job for the use-case where most there will be many write operations affecting many CM-handles. It works by fetching ALL CM-handles into memory. Issue-ID: CPS-2692 Change-Id: I3a51a9f799ff7521a2a3736440482538de6aa204 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2025-03-13Move CPS REST business logic to CPS-Service LayerToineSiebelink1-7/+5
(scope limited to methods using PrefixResolver) - Introduced CPSFacade (for methods invoking multiple CPS Services related to Prefix insertion) - Introduced DataMapper to combine PrefixResolver & DataMapUtils - Moved includeDecendants boolean to Enum conversion to Enum class - Removed redundant tests from DataRestControllerSpec - Removed redundant tests from QueryRestControllerSpec - Cleaned up some legacy testware (adding assert etc) Issue-ID: CPS-2428 Change-Id: Ib3b4dae941ada441be0dc76aaa5cd14e48685cf7 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2025-03-12Optimize Hazelcast usage in Trust Level Searchseanbeirne2-9/+11
Issue-ID: CPS-2674 Change-Id: I1f2fa5dce82eefbc99906bc468c6541f0d35851b Signed-off-by: seanbeirne <sean.beirne@est.tech>
2025-03-10Merge "Added query limits to NCMP service methods"Toine Siebelink5-10/+28
2025-03-10Merge "Optimize registration parameters"Toine Siebelink3-3/+3
2025-03-07Optimize registration parametershalil.cakal3-3/+3
- change internal batch size from 100 to 300 - change input batch size from 100 to 2000 in k6 tests Issue-ID: CPS-2686 Change-Id: If9645facaee6c0d745a1e9dd12962a27e110f787 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2025-03-06Added query limits to NCMP service methodsleventecsanyi5-10/+28
- modified CmHandleQueryService if - added limits to certain Impl methods Issue-ID: CPS-2678 Change-Id: Ia5fd58afcd6f48404aeafba08ee2977c3efc6dcc Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
2025-03-05Omit decendents when resolving AlternateIdseanbeirne5-19/+25
Issue-ID: CPS-2652 Change-Id: Ifcaa62d251ab0e4c926f13180acde90a02778c74 Signed-off-by: seanbeirne <sean.beirne@est.tech>
2025-03-05Merge "Use attribute-axis in NCMP [#2]"Daniel Hanrahan2-28/+23
2025-03-05Merge "Add conditionalProperty for DeviceTrustLevelMessageConsumer"Daniel Hanrahan1-0/+2
2025-03-04Use attribute-axis in NCMP [#2]emaclee2-28/+23
- uses queryleaf API on the methods queryCmHandleAnyProperties Issue-ID: CPS-2665 Change-Id: Ibad5888ae8ec8f23348d90d7c99871b075479e03 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
2025-03-04Merge "Improved unit test related to cm handle reference lookup"Lee Anjella Macabuhay1-15/+17
2025-03-04Improved unit test related to cm handle reference lookupToineSiebelink1-15/+17
Issue-ID: CPS-2605 Change-Id: Iac36b4838f640fa0bb4bf6bcc41f8a72e8c3bd8e Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2025-03-04Merge "Use attribute-axis in NCMP [#1]"Daniel Hanrahan5-119/+102
2025-03-03Add conditionalProperty for DeviceTrustLevelMessageConsumeremaclee1-0/+2
Issue-ID: CPS-2556 Change-Id: Id3be9bccdf40065794654cc414ae75a2184aebb8 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
2025-02-28Merge "Change order of CM Handle Reference lookup depending on special ↵Sourabh Sourabh4-61/+45
character"
2025-02-27Change order of CM Handle Reference lookup depending on special characterseanbeirne4-61/+45
- implemented new algorithm using validator to rule out standard id / prefer alternate id - moved validator imp to cps-service (not in RI) TBC!!! - changed order of characters tested in validator to fail fast (on '=') - added Boolean variation validator method to reduce overhead and prevent logic based on exceptions - improved integration test to cover all scenarios - add performance test for alternate id look up (report only) - ensured all performance test use alternate ids it '=' - added small groovy tests to restore cps-ri code coverage to 0.31 Issue-ID: CPS-2605 Change-Id: Id9c22bb69904b7f5d376b7f8319332428435333e Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Signed-off-by: seanbeirne <sean.beirne@est.tech>
2025-02-27Use attribute-axis in NCMP [#1]emaclee5-119/+102
- uses queryleaf API on the methods getCmHandleReferencesByTrustLevel, getCmHandleReferencesByDmiPluginIdentifier Issue-ID: CPS-2663 Change-Id: Ib9ff3ceb58b14664660f2a92b02e0bacf00bebda Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
2025-02-25Event data schemas for NCMPmpriyank8-65/+97
- Updated the schema id as NCMP has a master copy of all the schemas that are used - Introduced an enum to keep track of the dataschemas at a single place. - Refactored NcmpEvent builder class to take type and dataschema as a parameter - Cleaned up dependencies - Refactored testware to prove the changes - Changes are according to the decisions recorded here https://lf-onap.atlassian.net/wiki/spaces/DW/pages/16554840/CPS-2425+Event+Schemas+in+ONAP#Agreed-Event-Schema-Names Issue-ID: CPS-2425 Change-Id: Icbda1aa20e3c4b0f2b6797d25b59e52cf9237c92 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2025-02-12Merge "Change Datajob Status return value"Priyank Maheshwari2-9/+7
2025-02-12Change Datajob Status return valueegernug2-9/+7
- Change to return entire JSON object instead of status string Issue-ID: CPS-2613 Change-Id: I63d8a9d078f003fc06e301bf9921f7942b3603ab Signed-off-by: egernug <gerard.nugent@est.tech>
2025-02-07Fix for intermittent failures of module sync testsdanielhanrahan2-3/+3
- Removed PollingConditions as ModuleSyncWatchdog is now synchronous - Use Hazelcast IMap::delete instead of IMap::removeAsync to fix root cause of test failures: removeAsync may not be finished when module sync is re-run during tests. Issue-ID: CPS-2615 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I1786a1303606132218dc8e4e91fb58e6f6cc0bcb
2025-02-06Merge "Fix duplicated yang resource references V2"Daniel Hanrahan1-7/+7
2025-02-06Fix duplicated yang resource references V2ToineSiebelink1-7/+7
- Store Yang module references using SchemaSetEntity instead of SQL - Added integration test to check number of references - Update dispatcher for integration test to only return yang resources requested modules - refactor schema set create & upgrade methods for better re-uses and readability - consistent naming in related methods like(new)yangResourceContentPerName (the name can be filename, module name or schema set name) depending on the context - replaced 'var' with actual class names in affected classes Issue-ID: CPS-2605 Change-Id: I8870c70832ac533bd17ce8af409a071f659e4acf Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2025-02-05Merge "Remove multithreading from module sync watchdog"Toine Siebelink8-274/+21
2025-02-05Merge "Change event topic name for trust level"Daniel Hanrahan2-12/+12
2025-02-04Remove multithreading from module sync watchdogdanielhanrahan8-274/+21
After introduction of module set tag improvements, there is no need to multithreading in module sync. Performance impact is minimal. Issue-ID: CPS-2165 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I1557fc8348d39da3654a1b92944c6ad49fa8670d
2025-01-30Fix deprecation issue related to KafkaContainermpriyank1-4/+3
- Replaced KafkaContainer with ConfluentKafkaContainer to fix the deprecation issue - Bumped the version of cp-kafka and cp-zookeeper to 7.8.0 - Removing reference of registry.nordix as the NCMP internal pipeline is no longer used Issue-ID: CPS-2608 Change-Id: Ic1f3edbc06d63c5f00c1ecb901e07a6bc17ae6eb Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2025-01-30Remove deprecated Rest endpoints for hazelcast healthmpriyank2-27/+2
- removing the hazelcast cluster rest health check endpoints Issue-ID: CPS-2612 Change-Id: I01ad0e4b4d8ad99ce7a6e4e4dc0f0a8272d39227 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2025-01-29Merge "Add "dataProducerId" and "dmiServiceName" values to ↵Lee Anjella Macabuhay2-5/+9
SubJobWriteResponse in sendRequestsToDmi method"
2025-01-29Add "dataProducerId" and "dmiServiceName" values to SubJobWriteResponse in ↵egernug2-5/+9
sendRequestsToDmi method - DMI call only returns subJobId - SubJobWriteResponse created using DMI response and request values Issue-ID: CPS-2497 Change-Id: Ib38132f2337de6a12b0b05bc6eebeed99f8d435d Signed-off-by: egernug <gerard.nugent@est.tech>
2025-01-29Address sonar violations related to hazelcastmpriyank1-1/+5
- Supressing warning caused by deprecation of RestApiConfig in hazelcast 5.5 community version , which will be removed in 6.0 so created https://lf-onap.atlassian.net/browse/CPS-2599 to address the issues - Other sonar fixes Issue-ID: CPS-2594 Change-Id: I2e95cd851eae74d8bbb4535cfbaed1dc1ef89543 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2025-01-28Merge "Send new module set tag to DMI during model upgrade"Daniel Hanrahan5-62/+82
2025-01-28Merge "Moved CpsValidator under the utils package"Daniel Hanrahan4-4/+4