summaryrefslogtreecommitdiffstats
path: root/ms/blueprintsprocessor/modules
AgeCommit message (Collapse)AuthorFilesLines
2022-09-28Release version 1.4.0 CDS artifactsTimoney, Dan (dt5972)27-27/+27
Release version 1.4.0 of ccsdk/cds artifacts and roll to next snapshot Issue-ID: CCSDK-3754 Signed-off-by: Timoney, Dan (dt5972) <dtimoney@att.com> Change-Id: I2b3844a40f94885b3ad08847f6a8145950ac46e0
2022-09-07Create dynamic data-type using all workflow stepsJozsef Csongvai1-1/+1
Only the first step was used to create dynamic data-type in imperative workflows. Unless the first step was targeting resource resolution component, the dynamic data-type would not be created. This prevents resolution of workflow input properties. Issue-ID: CCSDK-3764 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: Ic51808f2ee0d74d6c4b07565e0caf12adc3e2590
2022-09-01Http 204 response results with exception in rest resolutionFrank Kimmlingen2-3/+92
Issue-ID: CCSDK-3746 Signed-off-by: Frank Kimmlingen <frank.kimmlingen@telekom.de> Change-Id: I740c970de631e58902e6f92b9069aee8d3ae075b
2022-09-01Templating constants added to ResourceAssignmentLukasz Rajewski2-2/+8
Fixed values of inputs for resource assignment allow to build data dictionaries that are generic. Along with templating of outputs mapping, path, url and payload sdnc and aai dictionary entry may be one for support of all the attributes of specified object like for instance generic vnf one. Issue-ID: CCSDK-3716 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@t-mobile.pl> Change-Id: I1817303e997a4dfb7dda9c32d9ac690ec723b3d8
2022-09-01CDS max-occurrence featureJuhi Arora1-0/+3
As part of occurrence feature, one or more version of the resource resolution can be resolved. However, user did not have granular control in case the user wants to resolve a specific value once and never again. Max-Occurrence feature implements the granular control to be give the user an option to specify the max number of times a resource to be resolved. It is specified as part of mapping in a cba. Max-occurrence value of 0 or not specifying it explicitly denotes the current default behaviour of unlimited resoltions. If a user specify a particular max-occurrence value then the resource is resolved that many times in subsquent requests and never again once we reached the max-occurrence limit of resource resolutions. Issue-ID: CCSDK-3736 Change-Id: Ie18764a313530e36be14531d8c7b93bf54f0b651 Signed-off-by: kuldipr <kuldip.rai@amdocs.com>
2022-08-29Add endpoint for deleting templatesJozsef Csongvai1-0/+37
Issue-ID: CCSDK-3735 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Signed-off-by: kuldipr <kuldip.rai@amdocs.com> Change-Id: I80d0da87651933da103e79d878902da743bb134e
2022-08-24Refactor rest clients and support timeoutsLukasz Rajewski6-312/+384
- Refactored rest clients to remove redundant code - Timeouts added to the configuration of rest clients Issue-ID: CCSDK-3716 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@t-mobile.pl> Change-Id: I706b8efd8447570455b8b65bd5b1a22da474f62b
2022-08-22Fix inconsistency introduced during commit b4cbb0ee9kuldipr1-8/+1
Issue-ID: CCSDK-3738 Signed-off-by: kuldipr <kuldip.rai@amdocs.com> Change-Id: I72ae642f3027fa3b4c8caa3105b2147ed654c159
2022-08-04Kafka producer parameters updated to be consistent with frankfurtOleg Mitsura2-6/+6
Issue-ID: CCSDK-3737 Signed-off-by: kuldipr <kuldip.rai@amdocs.com> Change-Id: I00cba2f644abf85778abf17ee3fb9e102ac5f42f
2022-08-03Enable deleting resources by lastN occurrencesJozsef Csongvai2-8/+47
Also enable deletion using resource-type and resource-id. Issue-ID: CCSDK-3735 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Signed-off-by: kuldipr <kuldip.rai@amdocs.com> Change-Id: Id1b487fce97f582bd3781dfd5bcff61a8df08c5c
2022-07-21[Blueprintsprocessor] Blueprint Model API returns 204 NO CONTENT if ↵Michal Jagiello1-1/+1
blueprint model does not exist Issue-ID: CCSDK-3729 Signed-off-by: Michal Jagiello <michal.jagiello@t-mobile.pl> Change-Id: Ie19128d1ece6b229e5c2e5636ab3a7add4e2f3ef
2022-07-18Aligned attributes of CDS componentsLukasz Rajewski2-1/+12
Issue-ID: CCSDK-3698 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@t-mobile.pl> Change-Id: Ie5c78a9a347373b5faf588627e42138806d69c0c
2022-07-04Fixed Template API (resourceId and resoourceType) input validationkuldipr1-4/+4
Validation was always checking for resolutionKey even when it is not required when using resourceId and resourceType. Also artifactName which is always required could not have been sent along with resourceId and resourceType. Issue-ID: CCSDK-3713 Signed-off-by: kuldipr <kuldip.rai@amdocs.com> Change-Id: I4a2945397f10bf5c57a698894df09ee4fc5891d0
2022-06-07Improve log format consistencyJozsef Csongvai7-18/+67
Logs related to request processing should include: requestId, subrequestId and originatorId. Each API (rest,grpc,kafka) would produce different outputs, due to MDC context not being passed properly between coroutine contexts or values not being populated. Issue-ID: CCSDK-3686 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: Ibafdffd3409b9724ad91633ca5840070f7e287f5
2022-05-24Merge "Extend Template API to retrieve resolutions by occurrence"Jozsef Csongvai1-0/+54
2022-05-24API to resolve resources based on optional 'occurrence' optionskuldipr1-0/+54
User can specificy options to get firstN, lastN and by the Range (begin, end) of 'occurrence' to get the resolutions. If no options are specified, all the resolutions are returned in decending oder (latest on top). Map of resolutions are returned with 'occurrence' as the key to the corresponding list of resolutions. Issue-ID: CCSDK-3665 Signed-off-by: kuldipr <kuldip.rai@amdocs.com> Change-Id: I9ecbfb339bde76510e81cd695e03cc1e061396ee
2022-05-24Extend Template API to retrieve resolutions by occurrencejuhi arora1-0/+54
Add new endpoints - template to get firstN, lastN and by Range (begin, end) of 'occurrence' to get the templates Issue-ID: CCSDK-3666 Change-Id: I242626e826022ed8b70a0abc287560ea634121b7 Signed-off-by: juhi arora <juhi.arora1@bell.ca>
2022-05-23Merge "CCSDK-3671 add workflows list for grpc"Dan Timoney8-55/+154
2022-05-20Merge "Resource endpoint should support occurrences"Jozsef Csongvai1-3/+10
2022-05-19Override Request ID in MDC ContextJulien Fontaine2-4/+16
Issue-ID: CCSDK-3676 Signed-off-by: kuldipr <kuldip.rai@amdocs.com> Change-Id: I6b0a816fcb40e149be1818f9edc9d4839f1a4cf6
2022-05-19Resource endpoint should support occurrencesKuldip Rai1-3/+10
The getOneFromResolutionKey endpoint would fail if there are multiple occurrences for a resource. Instead it should return the last occurrence. Issue-ID: CCSDK-3664 Signed-off-by: kuldipr <kuldip.rai@amdocs.com> Change-Id: I1468c41c164f64931ce719f9908b935baae6e1a4
2022-05-19CCSDK-3671 add workflows list for grpcOleg Mitsura8-55/+154
Issue-ID: CCSDK-3671 1. added grpc 'getWorkflows' for BlueprintManagement 2. during CBA upload, the workflows get cached to BLUEPRINT_MODEL.workflows 3. reworked HTTP endpoint to use above "/workflows/blueprint-name/{name}/version/{version}" 4. If CDS is upgraded, with existing CBAs present, fallback by parsing the CBA instead of DB lookup Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: I68bebfe23c0b16ea288512f1087bfe1ceef57686
2022-05-17Fix broken model-type API endpointJozsef Csongvai1-1/+1
The endpoint path was accidentally changed with CCSDK-3014, where a trailing slash was added to the path. This reverts the endpoint path, and is still compatible with requests that have a trailing slash. Issue-ID: CCSDK-3672 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I071e15a525750d3068c53ff9f5447c524cd44669
2022-05-16Re-enable formatting and fix formatting issuesJozsef Csongvai3-6/+5
Issue-ID: CCSDK-3657 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: Idd1871e82a319325b042c339741a66c06499692c
2022-04-28Update versions for Kohn releaseDan Timoney27-27/+27
Update versions in master branch for Kohn release Issue-ID: CCSDK-3641 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I78cbfb5ec5175e87233f263422f7323b22d352de
2022-04-13Merge "Return errormessages in failing imperative workflows"KAPIL SINGAL2-2/+3
2022-04-12Prevent stack overflow in BluePrintProcessingGRPCHandlerJozsef Csongvai1-5/+4
The overridden onError is called when a terminating error occurs in the stream, for example when the calling client crashes. It should not be handled the same way as CBA processing errors. Issue-ID: CCSDK-3496 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: Ib0aa416325a5b9708615e0ef9d9c602df24518b9
2022-04-12Return errormessages in failing imperative workflowsJozsef Csongvai2-2/+3
Instead of discarding error messages after each node has executed, they are now kept until the workflow completes. If the workflow completes without exceptions, it means that all errors were handled and the error messages can be cleared. If the workflow does complete with exceptions, all error messages will be propagated in the response. Also update UatExecutor to enable expected status codes other than 200. Issue-ID: CCSDK-3630 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I94fd81c342ad2a798e64051c603beb62bf1aaacd
2022-03-29Release Jakarta M4 CDS maven artifactsDan Timoney27-27/+27
Release Jakarta M4 version of CDS maven artifacts and roll to next snapshot Issue-ID: CCSDK-3604 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I3335ce0e3f6995c350c5a87691e9922204a67dcb
2022-03-02DMAAP-1706 - New Kafka Auth optiondavid.mcweeney5-1/+192
Change-Id: I8533721d23d6adb41f65cb96fb2b8f852bda47b8 Signed-off-by: david.mcweeney <david.mcweeney@est.tech> Issue-ID: DMAAP-1706
2021-11-30CCSDK-3531 improve cmd-exec returned err msgOleg Mitsura2-2/+4
Issue-ID: CCSDK-3531 Improve end-user CBA's Python scripts ability to return error messages on failues. See JIRA story for examples: https://jira.onap.org/browse/CCSDK-3531 adds functions send_response_err_msg(err_message) and send_response_err_msg_and_exit(ret_err_msg, code=1) Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: Ideda64dd108f987c3c4515c70daf9f7b6d2b1f2f
2021-10-20Add missing code for Metrics and PV/PVC eliminationJozsef Csongvai8-3/+32
Earlier patch introducing MeterRegistry to AbstractComponentFunction was not initializing the lateinit property and causing NPE. Also add additional code to handle compatibility issues after the introduction of PV/PVC elminiation for CommandExecutor. This allows blueprintsprocessor to communicate with earlier versions of command- executor which still use the shared pvc. Issue-ID: CCSDK-3471 Change-Id: I84a04601c4fe09c5f3a06664ce877800a30531f1 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-09-29Merge "Metrics on command-executor blueprints processor side"Dan Timoney2-0/+4
2021-09-21Metrics on command-executor blueprints processor sideMichael Pruss2-0/+4
Issue-ID: CCSDK-3471 Signed-off-by: Michael Pruss <michprus@amdocs.com> Change-Id: I871a032ff5c9ebfd408aaa28a7d24185dee7c953
2021-09-21Roll versions for JakartaDan Timoney27-54/+27
Roll versions to set up for Jakarta release Issue-ID: CCSDK-3470 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: Ia341d92b79acd758cc9d16f24a83399d1a8a1c5b
2021-09-16Release version 1.2.0 maven artifactsDan Timoney27-27/+27
Release version 1.2.0 maven artifacts for CDS and roll version Issue-ID: CCSDK-3444 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I3e5beebd0e2aedb7d6f69ad854af879c20308c17
2021-09-13Fix versionDan Timoney1-1/+1
Should use project.version property for internal references, not hard-coded value. Otherwise, staging and docker builds break. Issue-ID: CCSDK-3460 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I5e9ac3b302f7b3c8a7ce8bc6f166f1a4c56af4f5
2021-09-10Upgrading velocity version to v2.3 due to some vulnerabilities in previous ↵meriem zidane5-5/+21
version Issue-ID: CCSDK-3430 Signed-off-by: Meriem Zidane <meriem.zidane@bell.ca> Change-Id: I82dad1c2dd7f8e4cc5712e9fddde5b1bb5429b7f
2021-09-01Merge "Upgrade hazelcast version"KAPIL SINGAL1-1/+1
2021-08-31Upgrade hazelcast versionmeriem zidane1-1/+1
Upgrade hazelcast version from 4.0.3 to 4.2.2 Issue-ID: CCSDK-3429 Signed-off-by: meriem zidane <meriem.zidane@bell.ca> Change-Id: I560e3970f84210d3c0e8c8f5eb569b5f2cf556e0
2021-08-27CCSDK-3434 CBA workflow status storeKavitha P15-6/+715
Change-Id: Iaeac6fa534c569bbc152e6c8a78c2dd23b6c4b1a Signed-off-by: Kavitha P <pkavitha@aarnanetworks.com> Issue-ID: CCSDK-3434
2021-07-28Revert "Renaming Files having BluePrint to have Blueprint"Jozsef Csongvai291-3334/+3334
The renaming in CCSDK-3098 caused breaking changes to the grpc api and compile issues for kotlin scripts. Issue-ID: CCSDK-3385 Change-Id: I0d745cb858371678eabcb2284671c1fd76a1ab6d Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-06-23Add Request ID and Sub Request ID to CDS kafka logsJulien Fontaine3-22/+23
Improved log message when a message is published or consumed by CDS Kafka to specify the RequestID and SubRequestID. Issue-ID: CCSDK-3348 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I50e068d9aa36df8fe4ee5f0f6a8e9bd7a1209467
2021-05-13Add MS SQL driver in CDS blueprints andPrudence Au5-1/+77
DB resolution fails on an empty dataset with required template mapping. Issue-ID: CCSDK-3293 Issue-ID: CCSDK-3294 Signed-off-by: Prudence Au <prudence.au@amdocs.com> Change-Id: I9f302d12e7359b62180fcdfddbd8ae2c993a8324
2021-04-28Merge "Fixed error when uploading CBA when Hazelcast cluster is not initialized"Dan Timoney1-4/+2
2021-04-28Fixed error when uploading CBA when Hazelcast cluster is not initializedJulien Fontaine1-4/+2
Hazelcast is used to enable CDS pods to notify the rest of the CDS cluster when a CBA got updated locally so they clean their compile cache (if they have an entry for that CBA). Though, the code doesn't make sure that hazelcast cluster is fully initialized before trying to notify using a hazelcast topic. Fixed that error by making sure that the cluster is fully initialized before pushing notification to hazelcast topic. Issue-ID: CCSDK-3277 Change-Id: I44211c63c5a991269005bcc238f18b19979cb718 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2021-04-28Add check for cluster status to readiness endpointJozsef Csongvai1-3/+14
When Cluster is enabled, BlueprintsProcessor should not process any requests until cluster is fully joined. Issue-ID: CCSDK-3275 Change-Id: I779159346976f7af0c0add69883f27d7f359f413 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-04-26Fix for CCSDK-3271 added kotlin compiler option java 11vmuthukrishnan@aarnanetworks.com1-0/+2
Issue-ID: CCSDK-3271 Change-Id: I9c007c9e332206fb1631442d6acfd41a1e57a882 Signed-off-by: vmuthukrishnan@aarnanetworks.com <vmuthukrishnan@aarnanetworks.com>
2021-04-22Fix grpcProperties resolution for String valuesJozsef Csongvai1-2/+3
When a CBA defines a String selector, it will be passed as TextNode. This enables using using application properties to define grpcClientProperties for py executor. Issue-ID: CCSDK-3272 Change-Id: Id4fcd4f43306e385458eb4decbb07f923a957cc0 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-04-07Remove trust all for BasicAuthRestClientServiceClaudio D. Gasparini1-18/+0
following global requirement expected in Istanbul, which forbids disabling host name verification Issue-ID: CCSDK-3245 Signed-off-by: Claudio D. Gasparini <claudio.gasparini@intl.att.com> Change-Id: I89c37a94cb3999a8f1813d3fc33958421b183de1