summaryrefslogtreecommitdiffstats
path: root/ms/blueprintsprocessor/modules
AgeCommit message (Collapse)AuthorFilesLines
2022-05-19Override Request ID in MDC ContextJulien Fontaine2-4/+16
Issue-ID: CCSDK-3676 Signed-off-by: kuldipr <kuldip.rai@amdocs.com> Change-Id: I6b0a816fcb40e149be1818f9edc9d4839f1a4cf6
2022-05-17Fix broken model-type API endpointJozsef Csongvai1-1/+1
The endpoint path was accidentally changed with CCSDK-3014, where a trailing slash was added to the path. This reverts the endpoint path, and is still compatible with requests that have a trailing slash. Issue-ID: CCSDK-3672 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I071e15a525750d3068c53ff9f5447c524cd44669
2022-05-16Re-enable formatting and fix formatting issuesJozsef Csongvai3-6/+5
Issue-ID: CCSDK-3657 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: Idd1871e82a319325b042c339741a66c06499692c
2022-04-28Update versions for Kohn releaseDan Timoney27-27/+27
Update versions in master branch for Kohn release Issue-ID: CCSDK-3641 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I78cbfb5ec5175e87233f263422f7323b22d352de
2022-04-13Merge "Return errormessages in failing imperative workflows"KAPIL SINGAL2-2/+3
2022-04-12Prevent stack overflow in BluePrintProcessingGRPCHandlerJozsef Csongvai1-5/+4
The overridden onError is called when a terminating error occurs in the stream, for example when the calling client crashes. It should not be handled the same way as CBA processing errors. Issue-ID: CCSDK-3496 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: Ib0aa416325a5b9708615e0ef9d9c602df24518b9
2022-04-12Return errormessages in failing imperative workflowsJozsef Csongvai2-2/+3
Instead of discarding error messages after each node has executed, they are now kept until the workflow completes. If the workflow completes without exceptions, it means that all errors were handled and the error messages can be cleared. If the workflow does complete with exceptions, all error messages will be propagated in the response. Also update UatExecutor to enable expected status codes other than 200. Issue-ID: CCSDK-3630 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I94fd81c342ad2a798e64051c603beb62bf1aaacd
2022-03-29Release Jakarta M4 CDS maven artifactsDan Timoney27-27/+27
Release Jakarta M4 version of CDS maven artifacts and roll to next snapshot Issue-ID: CCSDK-3604 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I3335ce0e3f6995c350c5a87691e9922204a67dcb
2022-03-02DMAAP-1706 - New Kafka Auth optiondavid.mcweeney5-1/+192
Change-Id: I8533721d23d6adb41f65cb96fb2b8f852bda47b8 Signed-off-by: david.mcweeney <david.mcweeney@est.tech> Issue-ID: DMAAP-1706
2021-11-30CCSDK-3531 improve cmd-exec returned err msgOleg Mitsura2-2/+4
Issue-ID: CCSDK-3531 Improve end-user CBA's Python scripts ability to return error messages on failues. See JIRA story for examples: https://jira.onap.org/browse/CCSDK-3531 adds functions send_response_err_msg(err_message) and send_response_err_msg_and_exit(ret_err_msg, code=1) Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: Ideda64dd108f987c3c4515c70daf9f7b6d2b1f2f
2021-10-20Add missing code for Metrics and PV/PVC eliminationJozsef Csongvai8-3/+32
Earlier patch introducing MeterRegistry to AbstractComponentFunction was not initializing the lateinit property and causing NPE. Also add additional code to handle compatibility issues after the introduction of PV/PVC elminiation for CommandExecutor. This allows blueprintsprocessor to communicate with earlier versions of command- executor which still use the shared pvc. Issue-ID: CCSDK-3471 Change-Id: I84a04601c4fe09c5f3a06664ce877800a30531f1 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-09-29Merge "Metrics on command-executor blueprints processor side"Dan Timoney2-0/+4
2021-09-21Metrics on command-executor blueprints processor sideMichael Pruss2-0/+4
Issue-ID: CCSDK-3471 Signed-off-by: Michael Pruss <michprus@amdocs.com> Change-Id: I871a032ff5c9ebfd408aaa28a7d24185dee7c953
2021-09-21Roll versions for JakartaDan Timoney27-54/+27
Roll versions to set up for Jakarta release Issue-ID: CCSDK-3470 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: Ia341d92b79acd758cc9d16f24a83399d1a8a1c5b
2021-09-16Release version 1.2.0 maven artifactsDan Timoney27-27/+27
Release version 1.2.0 maven artifacts for CDS and roll version Issue-ID: CCSDK-3444 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I3e5beebd0e2aedb7d6f69ad854af879c20308c17
2021-09-13Fix versionDan Timoney1-1/+1
Should use project.version property for internal references, not hard-coded value. Otherwise, staging and docker builds break. Issue-ID: CCSDK-3460 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I5e9ac3b302f7b3c8a7ce8bc6f166f1a4c56af4f5
2021-09-10Upgrading velocity version to v2.3 due to some vulnerabilities in previous ↵meriem zidane5-5/+21
version Issue-ID: CCSDK-3430 Signed-off-by: Meriem Zidane <meriem.zidane@bell.ca> Change-Id: I82dad1c2dd7f8e4cc5712e9fddde5b1bb5429b7f
2021-09-01Merge "Upgrade hazelcast version"KAPIL SINGAL1-1/+1
2021-08-31Upgrade hazelcast versionmeriem zidane1-1/+1
Upgrade hazelcast version from 4.0.3 to 4.2.2 Issue-ID: CCSDK-3429 Signed-off-by: meriem zidane <meriem.zidane@bell.ca> Change-Id: I560e3970f84210d3c0e8c8f5eb569b5f2cf556e0
2021-08-27CCSDK-3434 CBA workflow status storeKavitha P15-6/+715
Change-Id: Iaeac6fa534c569bbc152e6c8a78c2dd23b6c4b1a Signed-off-by: Kavitha P <pkavitha@aarnanetworks.com> Issue-ID: CCSDK-3434
2021-07-28Revert "Renaming Files having BluePrint to have Blueprint"Jozsef Csongvai291-3334/+3334
The renaming in CCSDK-3098 caused breaking changes to the grpc api and compile issues for kotlin scripts. Issue-ID: CCSDK-3385 Change-Id: I0d745cb858371678eabcb2284671c1fd76a1ab6d Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-06-23Add Request ID and Sub Request ID to CDS kafka logsJulien Fontaine3-22/+23
Improved log message when a message is published or consumed by CDS Kafka to specify the RequestID and SubRequestID. Issue-ID: CCSDK-3348 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I50e068d9aa36df8fe4ee5f0f6a8e9bd7a1209467
2021-05-13Add MS SQL driver in CDS blueprints andPrudence Au5-1/+77
DB resolution fails on an empty dataset with required template mapping. Issue-ID: CCSDK-3293 Issue-ID: CCSDK-3294 Signed-off-by: Prudence Au <prudence.au@amdocs.com> Change-Id: I9f302d12e7359b62180fcdfddbd8ae2c993a8324
2021-04-28Merge "Fixed error when uploading CBA when Hazelcast cluster is not initialized"Dan Timoney1-4/+2
2021-04-28Fixed error when uploading CBA when Hazelcast cluster is not initializedJulien Fontaine1-4/+2
Hazelcast is used to enable CDS pods to notify the rest of the CDS cluster when a CBA got updated locally so they clean their compile cache (if they have an entry for that CBA). Though, the code doesn't make sure that hazelcast cluster is fully initialized before trying to notify using a hazelcast topic. Fixed that error by making sure that the cluster is fully initialized before pushing notification to hazelcast topic. Issue-ID: CCSDK-3277 Change-Id: I44211c63c5a991269005bcc238f18b19979cb718 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2021-04-28Add check for cluster status to readiness endpointJozsef Csongvai1-3/+14
When Cluster is enabled, BlueprintsProcessor should not process any requests until cluster is fully joined. Issue-ID: CCSDK-3275 Change-Id: I779159346976f7af0c0add69883f27d7f359f413 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-04-26Fix for CCSDK-3271 added kotlin compiler option java 11vmuthukrishnan@aarnanetworks.com1-0/+2
Issue-ID: CCSDK-3271 Change-Id: I9c007c9e332206fb1631442d6acfd41a1e57a882 Signed-off-by: vmuthukrishnan@aarnanetworks.com <vmuthukrishnan@aarnanetworks.com>
2021-04-22Fix grpcProperties resolution for String valuesJozsef Csongvai1-2/+3
When a CBA defines a String selector, it will be passed as TextNode. This enables using using application properties to define grpcClientProperties for py executor. Issue-ID: CCSDK-3272 Change-Id: Id4fcd4f43306e385458eb4decbb07f923a957cc0 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-04-07Remove trust all for BasicAuthRestClientServiceClaudio D. Gasparini1-18/+0
following global requirement expected in Istanbul, which forbids disabling host name verification Issue-ID: CCSDK-3245 Signed-off-by: Claudio D. Gasparini <claudio.gasparini@intl.att.com> Change-Id: I89c37a94cb3999a8f1813d3fc33958421b183de1
2021-03-25Address some pendings items for SSLBasicAuthRestClientClaudio D. Gasparini5-27/+50
- FIXME under SSLBasicAuthRestClientProperties - TODO under SSLBasicAuthRestClientPropertiesBuilder Issue-ID: CCSDK-3235 Signed-off-by: Claudio D. Gasparini <claudio.gasparini@intl.att.com> Change-Id: If00c7491573c69eb5d3f9192f54c7b384943abf7
2021-03-23Fix Certificate Exception when using BasicAuthRestClientServiceClaudio D. Gasparini1-0/+18
by using TrustAllStrategy Issue-ID: CCSDK-3234 Signed-off-by: Claudio D. Gasparini <claudio.gasparini@intl.att.com> Change-Id: I7ee63739b4f1d7a4ddbc618ba660704aa058752a
2021-03-22Bug fixes for config template and config value componentsLukasz Rajewski3-0/+18
Issue-ID: CCSDK-3232 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@orange.com> Change-Id: I817d83001a76ba480472c7aa2da15eba65b39c20
2021-03-19Prohibit cycles in imperative workflowsJozsef Csongvai4-13/+107
Issue-ID: CCSDK-3221 Change-Id: I767003dde40c0fc53a673c4a41cb2430624d7b04 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-03-17Refactoring to enable on_failure for imperative workflowJozsef Csongvai22-53/+83
BlueprintError needs to associate errors with the steps in which they occurred in order for imperative workflow to handle on_failure properly. Made stepName more accessible and corrected places where stepName was assigned to nodeTemplateName. Issue-ID: CCSDK-3219 Change-Id: I7e5805745c63558cff6be533e1b99c32ad06c3db Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-03-16Assign a unique worker ID for CDS Kafka workerJulien Fontaine7-37/+113
* Modified CDS Kafka workers to add the 5 lasts characters of the env var HOSTNAME to their worker ID. * Small refactoring to move some utilitary functions to BlueprintMessageUtils Issue-ID: CCSDK-3204 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Iaacd35e9cbe4705d17548518040c679185eaf30a
2021-03-09Add delete endpoint for config snapshot APIJulien Fontaine2-1/+99
Add delete endpoint to delete config-snapshots based on resource-type, resource-id and resources-status. Issue-ID: CCSDK-3205 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Id7954694bc93beba08a79139834cb6477cb8e44b
2021-03-09Roll master version for IstanbulDan Timoney26-26/+26
Roll versions of ccskd parent poms to 2.2.0-SNAPSHOT and of ccsdk/cds to 1.2.0-SNAPSHOT for Istanbul release Issue-ID: CCSDK-3190 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: Iab0bf047c8d2e4ddaaadf2e6278917ed2de338e5
2021-03-04Release version 1.1.1 of CDS dockersDan Timoney26-26/+26
Release new CDS dockers to correct issues found with release 1.1.0 dockers. Issue-ID: CCSDK-3192 Issue-ID: CCSDK-3197 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I3bc1acbb93f0bb95ef14a6565e66d8da7a5df21d
2021-02-23Release version 1.1.0 docker containers and roll to next versionDan Timoney26-26/+26
Release version 1.1.0 docker containers and roll to next version Issue-ID: CCSDK-3179 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I2518ba1dd5a4bd926499867f5f9714bc3f716732
2021-02-11Added Kafka metrics for CDS workersJulien Fontaine15-44/+231
Added counters to gather metrics on CDS Kafka workers. This will enable us to get metrics on how many messages we consumer and produce to/from kafka. For consumers we count how many messages we consume and how many failed ie. consumed but not able to be processed (parsing error). For producers we count how many messages we produce and how many failed ie. failed to be pushed to the cluster (unavailable brokers, network error, ...). Relocated metrics tag constants to BlueprintConstants so that they can be use by any CDS module. If they make sense for other metrics then they should be shared. Issue-ID: CCSDK-3155 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Iad6aba588766f655f3a74cd626e0f74e29188f96
2021-02-11Improve logging for CDS Kafka workersJulien Fontaine4-28/+47
Modified CDS Kafka consumersand producers logs to provide more details about the topic of the consumer record being consumed or published. Refactored the publish callback to make it more readable. Refactored audit service log error messages. Issue-ID: CCSDK-3154 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I7b42930e926bc15ce175974a78d3bfe2f219b0a8
2021-02-09Instance dependencies in ComponentScriptExecutorLukasz Rajewski1-1/+7
Issue-ID: CCSDK-3146 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@orange.com> Change-Id: I6502abd0d2a3fa85cefc3bc6a900f27171b51569
2021-01-26PV/PVC eliminationOleg Mitsura4-2/+81
Issue-ID: CCSDK-3086 1. initial commit 2. fix accidental paste / rebased cleaned up unneeded validation call in cmd-exec upload Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: Ife5460c5be59aa8d8592d82099b27c507b08c6c6
2021-01-22Renaming Files having BluePrint to have BlueprintKAPIL SINGAL287-3287/+3287
Replacing BluePrint with Blueprint throughout Issue-ID: CCSDK-3098 Signed-off-by: KAPIL SINGAL <ks220y@att.com> Change-Id: Ibee8bad07ae7d9287073db2d4f2f2cd730fa8b96
2021-01-08CDS add Swagger annotations for Model Type APIPiotr Stanior1-1/+34
Issue-ID: CCSDK-3014 Change-Id: I469151beef8ebf63b3a24ca4ce9a047c0b80850a Signed-off-by: Piotr Stanior <piotr.stanior@t-mobile.pl>
2020-12-16Fixed NoClassDefFoundError when USE_SCRIPT_COMPILE_CACHE is set to falseJulien Fontaine12-25/+190
USE_SCRIPT_COMPILE_CACHE set to false cleans the Class Loader cache after each kotlin script execution. When several kotlin script are executed in parallel (ie no dependency between them) and USE_SCRIPT_COMPILE_CACHE=false then the class loader from the cache may be deleted before one of those executed kotlin script get the time to finish which to the NoClassDefFoundError. Removed cleanupInstance method for kotlin script executors that where causing the class loader to be removed prematurely. Now the behaviour is to remove the class loader from the cache only when we publish a new CBA which was already the case when CDS run with a single instance. In cluster mode, a topic has been added to hazelcast to allow the instance publishing the updated CBA to communicate to the other instances by sending a message to clean the class loader for this CBA from their cache. Added mutex on kotlin script compilation to fix race condition. For concurrent kotlin script execution each process wanted to compile an executable but it was causing a race condition if a process tries to execute while another still compile. Mutex on the execution path prevent this behaviour Issue-ID: CCSDK-3052 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I6ab002352b3272898ad0b183341ee664652c8ae3
2020-12-16Fixing typo in message-prioritizationSingal, Kapil (ks220y)6-6/+6
Refactoring few POMs name tag Issue-ID: CCSDK-3053 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I14447ea7f93efcc970213bbe7d42663cb87e33d7
2020-12-15CDS add Postman collection for Resource, Template, Dictionary and Config APIPiotr Stanior5-79/+77
Issue-ID: CCSDK-3014 Change-Id: Ic9892c035067064fd612f2781507a36072e4e712 Signed-off-by: Piotr Stanior <piotr.stanior@t-mobile.pl>
2020-12-14Merge "CDS API reference add request classes"KAPIL SINGAL1-8/+21
2020-12-14Merge "Pass on MDCContext to imperative workflow"KAPIL SINGAL2-4/+14