aboutsummaryrefslogtreecommitdiffstats
path: root/ms/blueprintsprocessor/modules/inbounds
AgeCommit message (Collapse)AuthorFilesLines
2021-04-05Release version 1.1.2 of dockers and roll versionDan Timoney7-7/+7
Release version 1.1.2 of dockers and roll version Issue-ID: CCSDK-3216 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I09a80dcacb57233f45eb5067573380783886826e
2021-03-24Refactoring to enable on_failure for imperative workflowJozsef Csongvai3-9/+5
BlueprintError needs to associate errors with the steps in which they occurred in order for imperative workflow to handle on_failure properly. Made stepName more accessible and corrected places where stepName was assigned to nodeTemplateName. Issue-ID: CCSDK-3219 Change-Id: I7e5805745c63558cff6be533e1b99c32ad06c3db Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> (cherry picked from commit b96b44d6d7ca11dbbc3ad4bd2194df31fba5efb6)
2021-03-04Release version 1.1.1 of CDS dockersDan Timoney7-7/+7
Release new CDS dockers to correct issues found with release 1.1.0 dockers. Issue-ID: CCSDK-3192 Issue-ID: CCSDK-3197 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I3bc1acbb93f0bb95ef14a6565e66d8da7a5df21d
2021-02-23Release version 1.1.0 docker containers and roll to next versionDan Timoney7-7/+7
Release version 1.1.0 docker containers and roll to next version Issue-ID: CCSDK-3179 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I2518ba1dd5a4bd926499867f5f9714bc3f716732
2021-02-11Added Kafka metrics for CDS workersJulien Fontaine5-32/+67
Added counters to gather metrics on CDS Kafka workers. This will enable us to get metrics on how many messages we consumer and produce to/from kafka. For consumers we count how many messages we consume and how many failed ie. consumed but not able to be processed (parsing error). For producers we count how many messages we produce and how many failed ie. failed to be pushed to the cluster (unavailable brokers, network error, ...). Relocated metrics tag constants to BlueprintConstants so that they can be use by any CDS module. If they make sense for other metrics then they should be shared. Issue-ID: CCSDK-3155 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Iad6aba588766f655f3a74cd626e0f74e29188f96
2021-02-11Improve logging for CDS Kafka workersJulien Fontaine2-16/+18
Modified CDS Kafka consumersand producers logs to provide more details about the topic of the consumer record being consumed or published. Refactored the publish callback to make it more readable. Refactored audit service log error messages. Issue-ID: CCSDK-3154 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I7b42930e926bc15ce175974a78d3bfe2f219b0a8
2021-01-22Renaming Files having BluePrint to have BlueprintKAPIL SINGAL64-682/+682
Replacing BluePrint with Blueprint throughout Issue-ID: CCSDK-3098 Signed-off-by: KAPIL SINGAL <ks220y@att.com> Change-Id: Ibee8bad07ae7d9287073db2d4f2f2cd730fa8b96
2021-01-08CDS add Swagger annotations for Model Type APIPiotr Stanior1-1/+34
Issue-ID: CCSDK-3014 Change-Id: I469151beef8ebf63b3a24ca4ce9a047c0b80850a Signed-off-by: Piotr Stanior <piotr.stanior@t-mobile.pl>
2020-12-16Fixing typo in message-prioritizationSingal, Kapil (ks220y)6-6/+6
Refactoring few POMs name tag Issue-ID: CCSDK-3053 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I14447ea7f93efcc970213bbe7d42663cb87e33d7
2020-12-15CDS add Postman collection for Resource, Template, Dictionary and Config APIPiotr Stanior5-79/+77
Issue-ID: CCSDK-3014 Change-Id: Ic9892c035067064fd612f2781507a36072e4e712 Signed-off-by: Piotr Stanior <piotr.stanior@t-mobile.pl>
2020-12-14Merge "CDS API reference add request classes"KAPIL SINGAL1-8/+21
2020-12-14CDS API reference add request classesJakobKrieg1-8/+21
Issue-ID: CCSDK-3014 Change-Id: If0a0a6169ac43a66c3dc51639e3a22efa49dcba5 Signed-off-by: JakobKrieg <jakob.krieg@bcmsolutions.de>
2020-12-14CDS add Swagger annotations for Resource, Template, Dictionary and Config APIPiotr Stanior5-34/+99
Issue-ID: CCSDK-3014 Change-Id: I380c38cde52a748a9b797c573b7651a766e8b496 Signed-off-by: Piotr Stanior <piotr.stanior@t-mobile.pl>
2020-12-08CDS add Swagger annotations for BP Model APIJakobKrieg2-34/+195
Issue-ID: CCSDK-3014 Change-Id: Ibca7cbaa2c70f04acf818e2b554664e13b116c5e Signed-off-by: JakobKrieg <jakob.krieg@bcmsolutions.de>
2020-12-02CDS Fix Swagger issuesPiotr Stanior1-0/+1
Fixed unique id generation for overloaded method. Changed example values in ApiModelProperty annotation to fix issues in Swagger json file. Issue-ID: CCSDK-3014 Change-Id: If83dc88187b62346182d1fb4b753aae544bbc322 Signed-off-by: Piotr Stanior <piotr.stanior@t-mobile.pl>
2020-10-28Blueprints Processor MetricsJulien Fontaine10-4/+147
Add counter and timer for Blueprints Processor process to get success/failure and execution time for each blueprint execution using blueprint name, version and action. Issue-ID: CCSDK-2950 Change-Id: I38e8997de26effe69ec2ee9e2b6ed0da14de4a43 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2020-09-22Roll to initial Honolulu versionDan Timoney7-7/+7
Roll to initial Honolulu version Issue-ID: CCSDK-2742 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I563033c6c93a4121219eaa1d7bb8a026e9e490d4
2020-09-22Enabling Code FormatterSingal, Kapil (ks220y)62-477/+662
Code Formatter was turned off due to java 11 migation Issue-ID: CCSDK-2852 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I3d02ed3cc7a93d7551fe25356512cfe8db1517d8
2020-09-21Fixing docker image tagSingal, Kapil (ks220y)1-1/+0
Moving related properties to parent most pom and using same across Removing unnecessary version tag from poms Issue-ID: CCSDK-2794 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I37d16d3f7a467bb579f70235f69a8bff0fe4ba8e
2020-09-11Refactoring poms groupId artifactIdSingal, Kapil (ks220y)7-38/+34
Issue-ID: CCSDK-2787 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: Ica64f0c793beabb47950c7bf1eede63a0dbf3cea
2020-09-10JDK11 upgradeOleg Mitsura1-1/+7
Issue-ID: CCSDK-1870 commit2: update surefire plugin to 3.0.0-M5. Need at least M3 for JDK11. S Still TODO: what to do about the spring-boot-parent. it may need a bump as well. commit3: update parent with surefire 3.0.0-M5 commit4: another surefire version update + failsafe version update. commit5: uncomment surefire def'n in parent pom. It may need to be redefined... commit6: update to parent 2.0.1-SNAPSHOT commits... rebasing/minorfixes commit14: disabling HealthCheckApplicationTests test commit19: Kapil bugfixes: Jsonfiles "isForce" replaces (incorrect) "force"; bumps kafka scala version to 2_13 commit20: fixe back kafka scala version to 2_11 commit25: reverted + applied patches for 2_13 (due to springboot parent update) + 'application' pom to use forCount=1 and reuseForks=false and reverted scanUatEmpoweredBlueprints modification in BluepritnsAcceptanceTest commit30: rebase commit31: SDCListener tests fixes. JMockit updated from 1.19 to 1.49. Since 1.42, need to do these changes https://jmockit.github.io/tutorial/Introduction.html#runningTests commit32: Dockerfiles cleanup. adduser/group params are different from Alpine. commit33: Dockerfile for SDClistener typo commit34: Addressed Dan's comments. commit35: Image was changed to 1.0.1 (which will be built soon), and the updated base image will already have 'onap' user and group, hence the adduser/group wouldn't be needed. commit36: rebase commit37: bumped up BP proc maven-surefire-plugin Xmx Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: I3d864d500150e7d81bb2ce73333f2db67c004e93
2020-09-02Adding parent pom referenceSingal, Kapil (ks220y)1-2/+1
Adding parent pom to cba-assembly-descriptor as it needs to inherit repository from parent so maven-deploy-plugin works Issue-ID: CCSDK-2720 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I44ce3721f280555b81475580ca47539ae83d07ca
2020-08-12Merge "Add functions/endpoints to fetch all config snapshots for a given ↵KAPIL SINGAL2-0/+188
resource type or Id - configs-snapshot rest API"
2020-08-12Append input param true in workflow-specjananib1-5/+32
Workflow spec Change-Id: Iac833abcc3d1079fbe8d12a354fd7ceff1aa758e Issue-ID: CCSDK-422 Signed-off-by: jananib <janani.b@huawei.com>
2020-08-11Add functions/endpoints to fetch all config snapshots for a given resource ↵Serge Simard2-0/+188
type or Id - configs-snapshot rest API Issue-ID: CCSDK-2641 Signed-off-by: Serge Simard <serge@agilitae.com> Change-Id: I392fa72bcbe39fd5306d4d2fdf7f49d62ec441b5
2020-08-10Merge "Make use of Kafka Key for Audit service and Kafka listener"KAPIL SINGAL2-5/+9
2020-08-07Kafka Audit Service: Error during sensitive data hidingJulien Fontaine1-54/+118
Changed behaviour during sensitive data hiding. Instead of looking for every node template defined in the CBA we only check for the ones declared for the current executed workflow. This prevent the issue when you have two independant workflows defined in the same CBA and one of those has a node template using a get_input expression for template-prefix in a component-resource-resolution. If you execute the other workflow audit service was still trying to resolve this expression which was making it fail. Issue-ID: CCSDK-2636 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Ib232c26ebf930917e19e7970e1a56c15e676888f
2020-08-04Make use of Kafka Key for Audit service and Kafka listenerJulien Fontaine2-5/+11
* When message is sent by audit service, key will be the CBA name * When sent by kafka listener (self-service api), key is the same as the request message key consumed. If not specified, a random UUID * MessageProducer interface refactoring : * add 'key' parameter to specify a key * add default value null to paramater 'headers' to remove some unnecessary method Issue-ID: CCSDK-2628 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I68580151184c87104c07037f379276dd8c8c71c7
2020-07-24Change EventListener functions to non-blocking scopeJozsef Csongvai1-1/+2
BluePrintProcessingKafkaConsumer and BluePrintProcessorCluster were both defining EventListener functions which were executed with runBlocking. When both were enabled, kafkaconsumer would block and cluster would never run. Issue-ID: CCSDK-2609 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I91813208f0474869f174da6c99280b5159859232
2020-07-09single /enrichandupload endpoint.Oleg Mitsura2-0/+37
Issue-ID: CCSDK-2540 rev1. initial commit rev2. spacing Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: I14c8ffa42214faf064d8697b00190dee80f5da1c
2020-07-09Set EventType for GRPC response in designer APIJozsef Csongvai2-0/+10
Issue-ID: CCSDK-2539 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: Iaaf64e4b6683c564c1022b609496fec55ad0df6d
2020-06-22Kafka Audit Service : Improve error handling and miscellaneous refactoringJulien Fontaine5-87/+96
When Kafka Audit Service fails it no longer stops Blueprint Processor execution * Add error handling when trying to hide sensitive data * Add error handling when trying to send kafka message * Set timeout for blocking loop when sending messages with kafka producer -> When broker is not available producer tries to reconnect in a blocking loop * Refactor Audit Service interface to give more explict name for publish methods * Modify publishExecutionOutput() to a non-blocking function Issue-ID: CCSDK-2459 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I809a5f34f81889aa9eed499608348f149984bc38
2020-06-19Error when template-prefix-names list is set as an inputJulien Fontaine1-1/+12
Case when template-prefix-names list for resource resolution is passed as an input was not handled. When the audit service was trying to get input-prefix-names values he was only getting {"get_input": "..."} and was not resolving this expression. Issue-ID: CCSDK-2456 Change-Id: If9ebbf0aa6b6eae3e44a7bfe0b930f622dfd3c1e Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2020-06-16Merge "providing search packages functionalities"Dan Timoney1-2/+2
2020-06-16add sort by versionShaabanEltanany1-1/+2
Issue-ID: CCSDK-2431 Signed-off-by: ShaabanEltanany <shaaban.eltanany.ext@orange.com> Change-Id: Idfeab7ba0757adea3c837b281d5da83b2dc95c4e
2020-06-16providing search packages functionalitiesShaabanEltanany1-2/+2
- provide search package by (UpdatedBy or Tags or ArtifactName or ArtifactVersion or ArtifactType) Containing IgnoreCase Issue-ID: CCSDK-2434 Signed-off-by: ShaabanEltanany <shaaban.eltanany.ext@orange.com> Change-Id: I92167e916643dbbf17601a0d9fb7654d8940a537
2020-05-27REST endpoint for fetching templates resolution results does not expose ↵Serge Simard1-3/+7
occurence parameter Issue-ID: CCSDK-2384 Change-Id: I8a6abfea32c7aacade1e9b3140eeed22fa58b4a9 Signed-off-by: Serge Simard <serge@agilitae.com>
2020-05-13Kafka Audit Service : Error with CBA using dg-generic node templateJulien Fontaine1-27/+35
* Fixed issue with dg-generic node template * Changed behaviour for hiding sensitive data -> Instead of just checking the node-template targeted by the workflow, we check every node-template declared in the CBA. If we find one or more component-resource-resolution node-template, we verify if we need to hide sensitive data in the kafka message. Issue-ID: CCSDK-2372 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I079ee29ae532b3947cdc8efe3438678309ca50b7
2020-05-11Kafka Audit Service : CorrelationUUID from request is not matching the ↵Julien Fontaine5-9/+7
correct response in Kafka Moved out CorrelationUUID linking between the request and the response from the Kafka Audit Service to the ExecutionServiceHandler. This prevents the race condition happening when several ExecutionServiceOutputs try to set the CorrelationUUID related to their ExecutionServiceInput. Issue-ID: CCSDK-2370 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I0c5934d4486961fbfcb34fd2d2492cd843350025
2020-05-06Merge "fix sort at package list"Dan Timoney1-4/+8
2020-05-05Truncate message published on Kafka / Spike: Define solution for logs separationJulien Fontaine2-10/+25
Refactoring of cmd-exec component - Improve display of error messages within the response - Fix gRPC buffer limitation (4Mb) by truncating error messages and cmd-exec logs if too heavy (>3Mb) Truncation of BP responses (<4Kb) before sending them in kafka audit topics. - Truncation if needed of error messages for every response - Truncation of cmd-exec logs in cmd-exec responses (Spike) Add a flag in the application.properties to enable/disable the display of cmd-exec responses on the BP side (Fix) Correction of BP processing with kafka regression (Fix) Changed default SSL Endpoint Algo Issue-ID: CCSDK-2326 Change-Id: If4d0e661117d1dd156cf19c95774824e754d870a Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2020-05-05fix sort at package listShaabanEltanany1-4/+8
Issue-ID: CCSDK-2320 Signed-off-by: ShaabanEltanany <shaaban.eltanany.ext@orange.com> Change-Id: Ia91d519c315b6ef0c01089422253599b137eceec
2020-04-24Merge "Secure Kafka Authentication"Dan Timoney3-1/+12
2020-04-21Secure Kafka AuthenticationJulien Fontaine3-1/+12
Implementation of kafka secure authentication : - SSL - SASL(SCRAM) & SSL Issue-ID: CCSDK-2313 Change-Id: I4b2fc7abab7478e360ebf461608a620d75708f54 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2020-04-16Workflow-spec returning error responsejananib1-6/+21
Fix workflow-spec query Change-Id: Ic66e2249b73c113cd25bd99c9cf33984520e31df Issue-ID: CCSDK-2181 Signed-off-by: jananib <janani.b@huawei.com>
2020-04-10Merge "Publish execution input/output into Kafka topics"Dan Timoney7-46/+349
2020-04-09Remove unneeded backup filesDan Timoney7-391/+0
Remove unneeded backup files created by updParentVersion script Issue-ID: CCSDK-2308 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I8d76b8ee3ccb2dbe563f22aadf1125f8226a104f
2020-04-08Publish execution input/output into Kafka topicsJulien Fontaine7-46/+349
- Creation and implementation of PublishAudit services (NoAudit,Kafka) - Conceal of sensitive data (request input parameters) - Update ExecutionServiceHandler tests - Update application.properties file Issue-ID: CCSDK-2183 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Ifc28a91ce588f5ed0010acb4ed22b64429c6c1a0
2020-04-08Merge "Refactoring BP Code with ErrorCatalog"Dan Timoney40-377/+458
2020-04-07Roll to next Guilin snapshotDan Timoney14-9/+407
Roll to next Guilin snapshot release Issue-ID: CCSDK-2152 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I1a5ea68da8821ffe28ac84e60177af05e26b3585