aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
31 hoursMerge "Efficient implementation of Attribute Axis in SQL"HEADmasterLee Anjella Macabuhay7-33/+70
32 hoursMerge "Fix NullPointerException for cm handle state metrics"Toine Siebelink5-103/+195
32 hoursMerge "Refactor Consumers/Producers based on agreed format"Priyank Maheshwari18-78/+77
32 hoursEfficient implementation of Attribute Axis in SQLdanielhanrahan7-33/+70
Attribute Axis is the feature which allows fetching only a single attribute, e.g. //books[@title='Matilda']/@price -> [15] This implements the attribute axis feature directly in SQL, giving much higher performance e.g. for CM-handle ID searches in NCMP. The native SQL implementation directly returns data leaves from DB, not requiring conversions to FragmentEntity, DataNode, etc. Issue-ID: CPS-2623 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I54f517e47ca6bcddfae356f98857b05fd2e1229e
34 hoursMerge "Use Flux stream processing for CM-handle searches"Toine Siebelink8-55/+53
2 daysAdd CloudEventBuilder to SpringBootTestegernug2-2/+4
There are test failures on: DmiInEventProducerSpec NcmpOutEventProducerSpec stemming from CloudEventBuilder being missing from the SpringBootTest. Adding this to clear issues. Issue-ID: CPS-2727 Change-Id: I5e838741d7fc54bc91c5d91497085da68ab391d4 Signed-off-by: egernug <gerard.nugent@est.tech>
2 daysFix NullPointerException for cm handle state metricshalil.cakal5-103/+195
- ensure the certain beans are created in a specific order: 1-AdminCacheConfig 2-CmHandleStateMonitor 3-CmHandleStateConfig - extract cm handle state config from MicroMeterRegistry to allow control order of bean initialization to prevent NullPointerException - introduce @DependsOn annotation Issue-ID: CPS-2677 Change-Id: I8dfec54cc7e603bded6a24e7362437042b222fd3 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2 daysMerge "Remove private properties from DMI write operations"Toine Siebelink3-13/+7
2 daysMerge "Use attribute-axis in NCMP [#4]"Daniel Hanrahan5-20/+61
2 daysUse Flux stream processing for CM-handle searchesdanielhanrahan8-57/+55
This greatly reduces memory consumption to fetch CM-handles in NCMP by fetching in batches in a Flux. Full CM-handle search operations now consume much less memory than before. The lower memory usage and database pressure improves overall performance. Issue-ID: CPS-2712 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I7f653fadeadbf9612e0847f9451654b01a1a5604
3 daysUse attribute-axis in NCMP [#4]emaclee5-20/+61
- introduce getCmHandleReferencesByCpsPath for queries by cps path in replacement for use of 'queryCmHandleAncestorsByCpsPath' Issue-ID: CPS-2666 Change-Id: I38b76e1f255ad1751b13f6a22dbcf540fed764bd Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
3 daysRefactor Consumers/Producers based on agreed formatemaclee18-78/+77
- agreed: consumer over producer - agreed: 'Consumer' is named based on what it consumes - agreed: no 'Publisher' in names, use producer instead - AsyncRestRequestResponseEventConsumer to DmiAsyncRequestResponseEventConsumer - LcmEventsService to LcmEventsProducer - CmAvcEventPublisher to InventoryEventProducer - CpsDataUpdateEventsService to CpsDataUpdateEventsProducer - see https://lf-onap.atlassian.net/wiki/spaces/DW/pages/16514237/CPS+Data+Notifications+Overview?force_transition=43836314-5d80-4b83-b9f4-7880332d79a4 for more info Issue-ID: CPS-2597 Change-Id: Iaafb435fcf985372d4858bcbbcd98901ac778b52 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
4 daysRemove private properties from DMI write operationssourabh_sourabh3-13/+7
Issue-ID: CPS-2693 Change-Id: Ibef6a3bed095bc668d07324bf7cf011fdb01da09 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
5 daysOptimize SQL for fetching descendant fragmentsdanielhanrahan2-17/+17
This removes the INNER JOIN from the SQL query, giving better performance when fetching smaller batches. Issue-ID: CPS-2712 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I40ec9b7b54c285cc29fd8188c23eb00b4442c75f
7 daysk6 script to do CM-handle registration onlydanielhanrahan1-0/+44
This script is intended to be used for populating the database with CM-handles, which is needed when doing SQL performance analysis. Issue-ID: CPS-2651 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ie644f5f4c86d91a95134b7c67ed96e0650464e0c
7 daysMerge "Add initial Liquibase database tag for rollback support"Daniel Hanrahan1-1/+7
7 daysMerge "Implemented parallel execution for writeDataJob using ExecutorService ↵Daniel Hanrahan2-12/+57
with 10 concurrent threads"
7 daysMerge "Use attribute-axis in NCMP [#3]"Daniel Hanrahan10-38/+86
7 daysImplemented parallel execution for writeDataJob using ExecutorService with ↵sourabh_sourabh2-12/+57
10 concurrent threads Issue-ID: CPS-2692 Change-Id: I497e2e626e60b08c6cf28ffa94884808d68a1dd9 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
7 daysAdd initial Liquibase database tag for rollback supportsourabh_sourabh1-1/+7
- Introduced an initial Liquibase database tag (24-initial database tag) to support future rollbacks. - Updated the Liquibase changelog to include a tagDatabase changeSet. - Ensures that rollback workflows can reference a stable database state. - No impact on existing functionality. Issue-ID: CPS-2669 Change-Id: I4f932bb0f90505cf95ddf74d2e57d7b4ea8fba79 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
8 daysUse attribute-axis in NCMP [#3]emaclee10-38/+86
- uses queryleaf API on the methods 'getCmHandleReferences' Issue-ID: CPS-2664 Change-Id: I7552b4cdfcfa5eb285b94c1dcebfa5ba8327508c Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
8 daysMerge "Introducing VES event standard schema"Toine Siebelink1-0/+3092
9 daysMerge "Enhance batch operation performance with AlternateIdMatcher"Toine Siebelink6-41/+12
9 daysEnhance batch operation performance with AlternateIdMatcherleventecsanyi6-41/+12
- used more efficient methos in AlternateIdMatcher to get cmHandleIds - removed getYangModelCmHandlesFromCmHandleReferences from InventoryPersistence class (unused + bad performance) Issue-ID: CPS-2607 Change-Id: Ia1970435aec57cd12713958a910a9ced4511440b Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
9 daysIntroducing VES event standard schemampriyank1-0/+3092
- ves event schema definition file - modified schema to generate the pojo classes as per NCMP standard - reference : https://docs.onap.org/projects/onap-vnfrqts-requirements/en/latest/Chapter8/ves_7_2/ves_event_listener_7_2.html# Issue-ID: CPS-2710 Change-Id: I332e3f3756bbd79b4acc3d5d338e9ae44ed4330e Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
9 daysMerge "Use only alternate id for passthrough read and write tests in k6 #2"Daniel Hanrahan4-62/+6
10 daysUse only alternate id for passthrough read and write tests in k6 #2halil.cakal4-62/+6
- remove cm handle based passthrough read and write tests in k6 - increase passthrough read and write frequencies to match FS requirement for 200K Issue-ID: CPS-2625 Change-Id: I9099163ea7e65d8cb8bc0226954bc9535ec6eb57 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2025-03-14Update release notes for attribute axisdanielhanrahan1-0/+1
Issue-ID: CPS-2624 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I669c0af944e1e6ae87e756670f8e6976ee9a925e
2025-03-14Merge "Add attribute-axis to CPS query nodes rest API"Priyank Maheshwari4-2/+51
2025-03-13Minor refactor of query parameters in FragmentQueryBuilderdanielhanrahan1-7/+1
Issue-ID: CPS-2623 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ib0f39dd0aeb5f8f52b856ff7aede635f3061927e
2025-03-13Merge "Optimize Hazelcast usage in Trust Level Search"Priyank Maheshwari2-9/+11
2025-03-13Merge "Add documentation for attribute-axis"Priyank Maheshwari1-2/+20
2025-03-13Add documentation for attribute-axisdanielhanrahan1-2/+20
Issue-ID: CPS-2624 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Iafa145d1fefbd26adc8786e4001d90883acf1463
2025-03-13Add attribute-axis to CPS query nodes rest APIdanielhanrahan4-2/+51
Support attribute-axis in query nodes api for both JSON and XML: /cps/v2/dataspaces/{dataspace}/anchors/{anchor}/nodes/query It allows such queries as: //books/@title which returns a JSON response like: [{"title":"Matilda"},{"title":"Dune"}] and an XML response like: <title>Matilda</title><title>Dune</title> Issue-ID: CPS-2620 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Iab51fbe76281740b8dbde373e11864d3509696ef
2025-03-13Batch fetch all CM-handles for faster data jobsourabh_sourabh8-124/+93
This optimizes the write data job for the use-case where most there will be many write operations affecting many CM-handles. It works by fetching ALL CM-handles into memory. Issue-ID: CPS-2692 Change-Id: I3a51a9f799ff7521a2a3736440482538de6aa204 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2025-03-13Move CPS REST business logic to CPS-Service LayerToineSiebelink19-629/+741
(scope limited to methods using PrefixResolver) - Introduced CPSFacade (for methods invoking multiple CPS Services related to Prefix insertion) - Introduced DataMapper to combine PrefixResolver & DataMapUtils - Moved includeDecendants boolean to Enum conversion to Enum class - Removed redundant tests from DataRestControllerSpec - Removed redundant tests from QueryRestControllerSpec - Cleaned up some legacy testware (adding assert etc) Issue-ID: CPS-2428 Change-Id: Ib3b4dae941ada441be0dc76aaa5cd14e48685cf7 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2025-03-13Merge "Add prometheus metrics for searches and id-searches"Toine Siebelink6-3/+266
2025-03-13Add prometheus metrics for searches and id-searchesmpriyank6-3/+266
- Added counter to record the number of invocations for id-searches and searches endpoint for cm handle ids - introducing a cps-interface tag to differentiate between inventory id-search and traditional id-search endpoints - used AOP to have minimal code in the controller layers Issue-ID: CPS-2611 Change-Id: Ib7db2a25f5f71d11872b779a23d38c1f7931410f Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2025-03-12Optimize Hazelcast usage in Trust Level Searchseanbeirne2-9/+11
Issue-ID: CPS-2674 Change-Id: I1f2fa5dce82eefbc99906bc468c6541f0d35851b Signed-off-by: seanbeirne <sean.beirne@est.tech>
2025-03-12Merge "Allow limiting results in queryDataLeaf"Toine Siebelink6-10/+45
2025-03-12Merge "Groovy performance test for attribute-axis"Toine Siebelink1-5/+23
2025-03-12Added performance test of DCM Write Operationsourabh_sourabh2-4/+83
- Improved maintainability by making alternateId generation customizable via function parameters - Extracted common logic into registerSequenceOfCmHandles to eliminate duplication. Issue-ID: CPS-2691 Change-Id: I3b7788115a74a89a87b5cddc93f4c5861e9ccd93 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2025-03-12Merge "Increase healthcheck retries for cps-and-ncmp"Daniel Hanrahan2-6/+6
2025-03-12Merge "Set a permanent directory for the container logs"Daniel Hanrahan1-1/+1
2025-03-12Merge "Refactor buildDataNodes to a separate service"Priyank Maheshwari8-150/+459
2025-03-12Refactor buildDataNodes to a separate serviceArpit Singh8-150/+459
- Moved the code for buildDataNodes from CpsDataServiceImpl.java to a separate service named DataNodeBuilderService.java - Renamed the methods to be clear and in-line with their intended use in DataNodeBuilderService class - Moved ROOT_NODE_XPATH and NO_PARENT_PATH to CpsPathUtils Issue-ID: CPS-2487 Change-Id: I46cf843ab79b1e2547d968fbd30528270b95cc16 Signed-off-by: Arpit Singh <AS00745003@techmahindra.com>
2025-03-11Set a permanent directory for the container logshalil.cakal1-1/+1
- Currently the container logs (cps-and-ncmp) being stored in the cps repository (in k6-tests/logs directory). In every build, cps code base being fetched freshly. Thus, the zipped container logs being lost. - Now, by using the WORKSPACE variable set by Jenkins job, the logs will be stored under the root directory of WORKSPACE permanently. Issue-ID: CPS-2676 Change-Id: I0f7f9a46b94fc3e438de39bbab04f9a59daf446b Signed-off-by: halil.cakal <halil.cakal@est.tech>
2025-03-11Increase healthcheck retries for cps-and-ncmphalil.cakal2-6/+6
- increase the healthcheck retries from 3 to 10 Issue-ID: CPS-2679 Change-Id: Idd541fd88eb804d552659c32f6c6c92a0919c405 Signed-off-by: halil.cakal <halil.cakal@est.tech>
2025-03-11Merge "Refactor CM Handle Properties to be more realistic into K6 tests"Toine Siebelink3-15/+26
2025-03-11Merge "Zip and store logs for containers"Toine Siebelink2-5/+46