summaryrefslogtreecommitdiffstats
path: root/ms/blueprintsprocessor/modules
AgeCommit message (Collapse)AuthorFilesLines
2021-02-23Release ccsdk/cds1.1.0jenkins-releng26-26/+26
2021-02-11Added Kafka metrics for CDS workersJulien Fontaine15-44/+231
Added counters to gather metrics on CDS Kafka workers. This will enable us to get metrics on how many messages we consumer and produce to/from kafka. For consumers we count how many messages we consume and how many failed ie. consumed but not able to be processed (parsing error). For producers we count how many messages we produce and how many failed ie. failed to be pushed to the cluster (unavailable brokers, network error, ...). Relocated metrics tag constants to BlueprintConstants so that they can be use by any CDS module. If they make sense for other metrics then they should be shared. Issue-ID: CCSDK-3155 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Iad6aba588766f655f3a74cd626e0f74e29188f96
2021-02-11Improve logging for CDS Kafka workersJulien Fontaine4-28/+47
Modified CDS Kafka consumersand producers logs to provide more details about the topic of the consumer record being consumed or published. Refactored the publish callback to make it more readable. Refactored audit service log error messages. Issue-ID: CCSDK-3154 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I7b42930e926bc15ce175974a78d3bfe2f219b0a8
2021-02-09Instance dependencies in ComponentScriptExecutorLukasz Rajewski1-1/+7
Issue-ID: CCSDK-3146 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@orange.com> Change-Id: I6502abd0d2a3fa85cefc3bc6a900f27171b51569
2021-01-26PV/PVC eliminationOleg Mitsura4-2/+81
Issue-ID: CCSDK-3086 1. initial commit 2. fix accidental paste / rebased cleaned up unneeded validation call in cmd-exec upload Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: Ife5460c5be59aa8d8592d82099b27c507b08c6c6
2021-01-22Renaming Files having BluePrint to have BlueprintKAPIL SINGAL287-3287/+3287
Replacing BluePrint with Blueprint throughout Issue-ID: CCSDK-3098 Signed-off-by: KAPIL SINGAL <ks220y@att.com> Change-Id: Ibee8bad07ae7d9287073db2d4f2f2cd730fa8b96
2021-01-08CDS add Swagger annotations for Model Type APIPiotr Stanior1-1/+34
Issue-ID: CCSDK-3014 Change-Id: I469151beef8ebf63b3a24ca4ce9a047c0b80850a Signed-off-by: Piotr Stanior <piotr.stanior@t-mobile.pl>
2020-12-16Fixed NoClassDefFoundError when USE_SCRIPT_COMPILE_CACHE is set to falseJulien Fontaine12-25/+190
USE_SCRIPT_COMPILE_CACHE set to false cleans the Class Loader cache after each kotlin script execution. When several kotlin script are executed in parallel (ie no dependency between them) and USE_SCRIPT_COMPILE_CACHE=false then the class loader from the cache may be deleted before one of those executed kotlin script get the time to finish which to the NoClassDefFoundError. Removed cleanupInstance method for kotlin script executors that where causing the class loader to be removed prematurely. Now the behaviour is to remove the class loader from the cache only when we publish a new CBA which was already the case when CDS run with a single instance. In cluster mode, a topic has been added to hazelcast to allow the instance publishing the updated CBA to communicate to the other instances by sending a message to clean the class loader for this CBA from their cache. Added mutex on kotlin script compilation to fix race condition. For concurrent kotlin script execution each process wanted to compile an executable but it was causing a race condition if a process tries to execute while another still compile. Mutex on the execution path prevent this behaviour Issue-ID: CCSDK-3052 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I6ab002352b3272898ad0b183341ee664652c8ae3
2020-12-16Fixing typo in message-prioritizationSingal, Kapil (ks220y)6-6/+6
Refactoring few POMs name tag Issue-ID: CCSDK-3053 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I14447ea7f93efcc970213bbe7d42663cb87e33d7
2020-12-15CDS add Postman collection for Resource, Template, Dictionary and Config APIPiotr Stanior5-79/+77
Issue-ID: CCSDK-3014 Change-Id: Ic9892c035067064fd612f2781507a36072e4e712 Signed-off-by: Piotr Stanior <piotr.stanior@t-mobile.pl>
2020-12-14Merge "CDS API reference add request classes"KAPIL SINGAL1-8/+21
2020-12-14Merge "Pass on MDCContext to imperative workflow"KAPIL SINGAL2-4/+14
2020-12-14CDS API reference add request classesJakobKrieg1-8/+21
Issue-ID: CCSDK-3014 Change-Id: If0a0a6169ac43a66c3dc51639e3a22efa49dcba5 Signed-off-by: JakobKrieg <jakob.krieg@bcmsolutions.de>
2020-12-14CDS add Swagger annotations for Resource, Template, Dictionary and Config APIPiotr Stanior6-34/+107
Issue-ID: CCSDK-3014 Change-Id: I380c38cde52a748a9b797c573b7651a766e8b496 Signed-off-by: Piotr Stanior <piotr.stanior@t-mobile.pl>
2020-12-14Pass on MDCContext to imperative workflowJozsef Csongvai2-4/+14
Issue-ID: CCSDK-3032 Change-Id: Id62ab38064d5d3b1a24db674804d710ca407940e Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2020-12-14Updating parent pom version to 2.1.1-SNAPSHOTSingal, Kapil (ks220y)1-1/+1
Comenting out testSampleAaiReq from RestClientServiceTest.kt as this is causing verify job timeout Issue-ID: CCSDK-3046 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I38d88814335b83167597c1a24162ad3c743355f3
2020-12-08CDS add Swagger annotations for BP Model APIJakobKrieg3-34/+215
Issue-ID: CCSDK-3014 Change-Id: Ibca7cbaa2c70f04acf818e2b554664e13b116c5e Signed-off-by: JakobKrieg <jakob.krieg@bcmsolutions.de>
2020-12-02CDS Fix Swagger issuesPiotr Stanior1-0/+1
Fixed unique id generation for overloaded method. Changed example values in ApiModelProperty annotation to fix issues in Swagger json file. Issue-ID: CCSDK-3014 Change-Id: If83dc88187b62346182d1fb4b753aae544bbc322 Signed-off-by: Piotr Stanior <piotr.stanior@t-mobile.pl>
2020-11-20Refactoring POM and removing duplicate dependencySingal, Kapil (ks220y)1-19/+4
Issue-ID: CCSDK-2998 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I68e5c0c89c8f7100c3f3725e1682676688c319ab
2020-11-12Merge "Remove URI encoding in BlueprintWebClientService"KAPIL SINGAL2-22/+6
2020-11-12Remove URI encoding in BlueprintWebClientServiceJozsef Csongvai2-22/+6
Malformed uri's should be handled by resource resolution in the cba Issue-ID: CCSDK-2980 Change-Id: I5c1cf97519a882ff5cf99e9850c65df9ba6d9c36 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2020-10-28Blueprints Processor MetricsJulien Fontaine10-4/+147
Add counter and timer for Blueprints Processor process to get success/failure and execution time for each blueprint execution using blueprint name, version and action. Issue-ID: CCSDK-2950 Change-Id: I38e8997de26effe69ec2ee9e2b6ed0da14de4a43 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2020-10-21Update AAI endpoints to /aai/v22 for HonoluluLasse Kaihlavirta1-11/+11
- Update all /aai/v21 references to /aai/v22 for Honolulu - note that the previous https://gerrit.onap.org/r/c/ccsdk/cds/+/114057 was for Guilin only Issue-ID: CCSDK-2914 Signed-off-by: Lasse Kaihlavirta <l.kaihlavirt@partner.samsung.com> Change-Id: I8103b12610a9de7263789a0852140f2f0bb09393
2020-10-20Update AAI endpoints to /aai/v21Lasse Kaihlavirta1-11/+11
- Update all /aai/v14 references to /aai/v21 to resolve certificate problems in CDS when trying to resolve attribute values with aai-data source Issue-ID: CCSDK-2914 Signed-off-by: Lasse Kaihlavirta <l.kaihlavirt@partner.samsung.com> Change-Id: I6b150348b66e93b3d08ceaa49fa997d531ddb0e4
2020-09-30Fix service blueprintsJozsef Csongvai2-0/+2
Blueprints were failing enrichment. Cba's were referencing requirement restconf-connection which is not defined in component-netconf-executor. Added new capability for restconf and fixed referencing Issue-ID: CCSDK-2859 Change-Id: I13f8800ea5fad9daed8a8b7b81cc3649efbebbc9 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2020-09-22Roll to initial Honolulu versionDan Timoney26-26/+26
Roll to initial Honolulu version Issue-ID: CCSDK-2742 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I563033c6c93a4121219eaa1d7bb8a026e9e490d4
2020-09-22Enabling Code FormatterSingal, Kapil (ks220y)202-1511/+2072
Code Formatter was turned off due to java 11 migation Issue-ID: CCSDK-2852 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I3d02ed3cc7a93d7551fe25356512cfe8db1517d8
2020-09-21Fixing docker image tagSingal, Kapil (ks220y)2-2/+0
Moving related properties to parent most pom and using same across Removing unnecessary version tag from poms Issue-ID: CCSDK-2794 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I37d16d3f7a467bb579f70235f69a8bff0fe4ba8e
2020-09-11Refactoring poms groupId artifactIdSingal, Kapil (ks220y)26-154/+144
Issue-ID: CCSDK-2787 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: Ica64f0c793beabb47950c7bf1eede63a0dbf3cea
2020-09-10JDK11 upgradeOleg Mitsura3-7/+8
Issue-ID: CCSDK-1870 commit2: update surefire plugin to 3.0.0-M5. Need at least M3 for JDK11. S Still TODO: what to do about the spring-boot-parent. it may need a bump as well. commit3: update parent with surefire 3.0.0-M5 commit4: another surefire version update + failsafe version update. commit5: uncomment surefire def'n in parent pom. It may need to be redefined... commit6: update to parent 2.0.1-SNAPSHOT commits... rebasing/minorfixes commit14: disabling HealthCheckApplicationTests test commit19: Kapil bugfixes: Jsonfiles "isForce" replaces (incorrect) "force"; bumps kafka scala version to 2_13 commit20: fixe back kafka scala version to 2_11 commit25: reverted + applied patches for 2_13 (due to springboot parent update) + 'application' pom to use forCount=1 and reuseForks=false and reverted scanUatEmpoweredBlueprints modification in BluepritnsAcceptanceTest commit30: rebase commit31: SDCListener tests fixes. JMockit updated from 1.19 to 1.49. Since 1.42, need to do these changes https://jmockit.github.io/tutorial/Introduction.html#runningTests commit32: Dockerfiles cleanup. adduser/group params are different from Alpine. commit33: Dockerfile for SDClistener typo commit34: Addressed Dan's comments. commit35: Image was changed to 1.0.1 (which will be built soon), and the updated base image will already have 'onap' user and group, hence the adduser/group wouldn't be needed. commit36: rebase commit37: bumped up BP proc maven-surefire-plugin Xmx Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: I3d864d500150e7d81bb2ce73333f2db67c004e93
2020-09-07Add k8s-upload-profile templating and packagingLukasz Rajewski3-0/+18
Issue-ID: CCSDK-2631 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@orange.com> Change-Id: Id520338ffc2f43821d114b037467fbcc2f042b66
2020-09-02Adding parent pom referenceSingal, Kapil (ks220y)2-3/+2
Adding parent pom to cba-assembly-descriptor as it needs to inherit repository from parent so maven-deploy-plugin works Issue-ID: CCSDK-2720 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I44ce3721f280555b81475580ca47539ae83d07ca
2020-08-27KafkaMessageConsumerService: 'launch' was missingOleg Mitsura1-9/+12
Issue-ID: CCSDK-2704 This was accidentally removed few commits back. Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: I8f08c72e8d5695c1262aad2d10d1081bbabbdfcb
2020-08-25CommandResult info appears in CDS logs by defaultJulien Fontaine3-2/+13
Add config property to enable/disable logging of the command result. Now command result logs aren't printed by default. Issue-ID: CCSDK-2693 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I5107ed6acc150875264a65bf1c64962ff26cfd78
2020-08-24Add request IDs in command-executor logJulien Fontaine4-1/+22
* Update gRPC interface to handle SubRequestID and Originator ID * Update command-executor log format to handle request IDs in the log statement * Add SubRequest ID and Originator ID in BP log statement Issue-ID: CCSDK-2687 Change-Id: If261bb0912df5800ed2fc65371c5ee784d6a45fb Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2020-08-24fixes for J11Michael Dürre1-2/+7
fix pom files for J11 compile issues Issue-ID: CCSDK-2680 Signed-off-by: Michael Dürre <michael.duerre@highstreet-technologies.com> Change-Id: Iaa7a426cdf947288af64d41a94d954a933217332 Signed-off-by: Michael Dürre <michael.duerre@highstreet-technologies.com>
2020-08-12Merge "Add functions/endpoints to fetch all config snapshots for a given ↵KAPIL SINGAL2-0/+188
resource type or Id - configs-snapshot rest API"
2020-08-12Append input param true in workflow-specjananib2-5/+34
Workflow spec Change-Id: Iac833abcc3d1079fbe8d12a354fd7ceff1aa758e Issue-ID: CCSDK-422 Signed-off-by: jananib <janani.b@huawei.com>
2020-08-11Add functions/endpoints to fetch all config snapshots for a given resource ↵Serge Simard2-0/+188
type or Id - configs-snapshot rest API Issue-ID: CCSDK-2641 Signed-off-by: Serge Simard <serge@agilitae.com> Change-Id: I392fa72bcbe39fd5306d4d2fdf7f49d62ec441b5
2020-08-10Merge "Make use of Kafka Key for Audit service and Kafka listener"KAPIL SINGAL10-56/+45
2020-08-07Kafka Audit Service: Error during sensitive data hidingJulien Fontaine2-54/+120
Changed behaviour during sensitive data hiding. Instead of looking for every node template defined in the CBA we only check for the ones declared for the current executed workflow. This prevent the issue when you have two independant workflows defined in the same CBA and one of those has a node template using a get_input expression for template-prefix in a component-resource-resolution. If you execute the other workflow audit service was still trying to resolve this expression which was making it fail. Issue-ID: CCSDK-2636 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Ib232c26ebf930917e19e7970e1a56c15e676888f
2020-08-04Make use of Kafka Key for Audit service and Kafka listenerJulien Fontaine10-56/+47
* When message is sent by audit service, key will be the CBA name * When sent by kafka listener (self-service api), key is the same as the request message key consumed. If not specified, a random UUID * MessageProducer interface refactoring : * add 'key' parameter to specify a key * add default value null to paramater 'headers' to remove some unnecessary method Issue-ID: CCSDK-2628 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I68580151184c87104c07037f379276dd8c8c71c7
2020-07-29Improve Kafka Producer callback messagesJulien Fontaine1-2/+13
Check if message sent is a BP request/response to print CBA name and version in the callback message. Issue-ID: CCSDK-2623 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I526a01299a3bfca3d1c4a10ae19dead46393a9ae
2020-07-24Change EventListener functions to non-blocking scopeJozsef Csongvai1-1/+2
BluePrintProcessingKafkaConsumer and BluePrintProcessorCluster were both defining EventListener functions which were executed with runBlocking. When both were enabled, kafkaconsumer would block and cluster would never run. Issue-ID: CCSDK-2609 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I91813208f0474869f174da6c99280b5159859232
2020-07-09single /enrichandupload endpoint.Oleg Mitsura2-0/+37
Issue-ID: CCSDK-2540 rev1. initial commit rev2. spacing Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: I14c8ffa42214faf064d8697b00190dee80f5da1c
2020-07-09Set EventType for GRPC response in designer APIJozsef Csongvai2-0/+10
Issue-ID: CCSDK-2539 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: Iaaf64e4b6683c564c1022b609496fec55ad0df6d
2020-07-06Merge "Fix misleading errormessages in script exeutors"KAPIL SINGAL2-2/+2
2020-07-06Fix misleading errormessages in script exeutorsJozsef Csongvai2-2/+2
Issue-ID: CCSDK-2528 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I1a8dfc14b1fbddced4a3c2a06f8a35df34303976
2020-07-03Add error handling for CDS Kafka Producer callbackJulien Fontaine1-1/+2
Issue-ID: CCSDK-2522 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Ia7aabaa6d978a13fbf657ea6b406e0b37bc02222
2020-06-30Fix incorrect error handling for resolveWorkflowOutputsJozsef Csongvai2-2/+62
Issue-ID: CCSDK-2504 Change-Id: Ie910e47bb97be2db4f4a4e94653e5ae474a78c0d Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>