summaryrefslogtreecommitdiffstats
path: root/ms/blueprintsprocessor
AgeCommit message (Collapse)AuthorFilesLines
2020-06-22Kafka Audit Service : Improve error handling and miscellaneous refactoringJulien Fontaine9-95/+112
When Kafka Audit Service fails it no longer stops Blueprint Processor execution * Add error handling when trying to hide sensitive data * Add error handling when trying to send kafka message * Set timeout for blocking loop when sending messages with kafka producer -> When broker is not available producer tries to reconnect in a blocking loop * Refactor Audit Service interface to give more explict name for publish methods * Modify publishExecutionOutput() to a non-blocking function Issue-ID: CCSDK-2459 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I809a5f34f81889aa9eed499608348f149984bc38
2020-06-19Implement nodetemplate locking featureJozsef Csongvai13-34/+287
Enables locking execution of a nodetemplate using a lock key and lock acquire timeout. Issue-ID: CCSDK-2460 Change-Id: I308d4d89dab44b7f7a766d5b62258e67b051eab1 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2020-06-19Error when template-prefix-names list is set as an inputJulien Fontaine2-2/+13
Case when template-prefix-names list for resource resolution is passed as an input was not handled. When the audit service was trying to get input-prefix-names values he was only getting {"get_input": "..."} and was not resolving this expression. Issue-ID: CCSDK-2456 Change-Id: If9ebbf0aa6b6eae3e44a7bfe0b930f622dfd3c1e Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2020-06-18Missing note of timeout differences.Oleg Mitsura1-3/+8
rev1. initial commit rev2. spacing (silly klint!) Issue-ID: CCSDK-2445 Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: Ie8cc62c89e212efbf5240304856b79c173c88abb
2020-06-16Merge "providing search packages functionalities"Dan Timoney3-4/+4
2020-06-16add sort by versionShaabanEltanany1-1/+2
Issue-ID: CCSDK-2431 Signed-off-by: ShaabanEltanany <shaaban.eltanany.ext@orange.com> Change-Id: Idfeab7ba0757adea3c837b281d5da83b2dc95c4e
2020-06-16providing search packages functionalitiesShaabanEltanany3-4/+4
- provide search package by (UpdatedBy or Tags or ArtifactName or ArtifactVersion or ArtifactType) Containing IgnoreCase Issue-ID: CCSDK-2434 Signed-off-by: ShaabanEltanany <shaaban.eltanany.ext@orange.com> Change-Id: I92167e916643dbbf17601a0d9fb7654d8940a537
2020-06-15add package description to be at Entry definitionShaabanEltanany2-1/+3
Issue-ID: CCSDK-2438 Signed-off-by: ShaabanEltanany <shaaban.eltanany.ext@orange.com> Change-Id: I8657560cd55a21421dc6849d7aac64c02e83db42
2020-06-12add error-messages_en.properties to the blueprint processor docker imageAbdelmuhaimen Seaudi1-0/+1
Issue-ID: CCSDK-2444 Signed-off-by: Abdelmuhaimen Seaudi <abdelmuhaimen.seaudi@orange.com> Change-Id: Iccdd77676606fc3007568a76402ef0696e6a1653
2020-06-09Add ResourceResolutionResult to ResourceResolutionServiceJozsef Csongvai11-56/+106
In order to ensure consistent behavior for assignment-map, supporting occurences and multiple artifact-prefixes, ResourceResolutionService needs to return assignment-map alongside generated template content. Issue-ID: CCSDK-2389 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I54c1991d23d65217f3492b08a2170a6d41b6482d
2020-06-05Merge "Changed sli-provider dependency"Dan Timoney1-1/+2
2020-06-04Changed sli-provider dependencyDan Timoney1-1/+2
Due to refactoring in sli/core, the dependency sli-provider-base should now be used in place of sli-provider. Issue-ID: CCSDK-2412 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I35e356dd80cc355aedf74a9adb49665a1292d77c
2020-06-03Set explicit uid and gid in dockerfilesJozsef Csongvai1-1/+1
This fixes permission issues with shared nfs volumes caused by mismatch in dynamically assigned gid and uid between containers. Issue-ID: CCSDK-2398 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: Ie47873c98211b280490ee7a6bcc60ceef49dd690
2020-05-27REST endpoint for fetching templates resolution results does not expose ↵Serge Simard1-3/+7
occurence parameter Issue-ID: CCSDK-2384 Change-Id: I8a6abfea32c7aacade1e9b3140eeed22fa58b4a9 Signed-off-by: Serge Simard <serge@agilitae.com>
2020-05-27Fix sub-attribute parsing for accessing resolved valuesJozsef Csongvai6-1/+43
Added assignment-map attribute to ResourceResolutionComponent. This attribute will hold a json object with the resolved values for each artifact-prefix. It will enable accessing any resolved value, using get_attribute with JsonPath. Issue-ID: CCSDK-2389 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I3441569d9766fbd79703d2f224de448edd56dbb2
2020-05-19Improve logging for ResourceAssingmentUtilsJozsef Csongvai2-7/+16
Sort keys for generated resource param data logging Issue-ID: CCSDK-2381 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: Iea0a88fbe915e41e399ced45d842a8ef14d052c1
2020-05-19Fix incorrect encoding for query paramsJozsef Csongvai2-1/+37
Issue-ID: CCSDK-2380 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I3a49f2c5a3a29383e43e2a4a3d6a9c13a9f933c2
2020-05-19Merge "Add Naming Service & IP Assign custom resource resolution capability"Dan Timoney10-28/+1076
2020-05-18Add Naming Service & IP Assign custom resource resolution capabilityPaira, Saurav(sp694w)10-28/+1076
Issue-ID: CCSDK-2185 Signed-off-by: Paira, Saurav(sp694w) <sp694w@att.com> Change-Id: I70550fe9582b2db0a70c7b66591438b674173411
2020-05-13Kafka Audit Service : Error with CBA using dg-generic node templateJulien Fontaine2-27/+37
* Fixed issue with dg-generic node template * Changed behaviour for hiding sensitive data -> Instead of just checking the node-template targeted by the workflow, we check every node-template declared in the CBA. If we find one or more component-resource-resolution node-template, we verify if we need to hide sensitive data in the kafka message. Issue-ID: CCSDK-2372 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I079ee29ae532b3947cdc8efe3438678309ca50b7
2020-05-11Kafka Audit Service : CorrelationUUID from request is not matching the ↵Julien Fontaine5-9/+7
correct response in Kafka Moved out CorrelationUUID linking between the request and the response from the Kafka Audit Service to the ExecutionServiceHandler. This prevents the race condition happening when several ExecutionServiceOutputs try to set the CorrelationUUID related to their ExecutionServiceInput. Issue-ID: CCSDK-2370 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I0c5934d4486961fbfcb34fd2d2492cd843350025
2020-05-06Merge "fix sort at package list"Dan Timoney1-4/+8
2020-05-06Merge "Truncate message published on Kafka / Spike: Define solution for logs ↵Dan Timoney9-47/+174
separation"
2020-05-05Truncate message published on Kafka / Spike: Define solution for logs separationJulien Fontaine9-47/+174
Refactoring of cmd-exec component - Improve display of error messages within the response - Fix gRPC buffer limitation (4Mb) by truncating error messages and cmd-exec logs if too heavy (>3Mb) Truncation of BP responses (<4Kb) before sending them in kafka audit topics. - Truncation if needed of error messages for every response - Truncation of cmd-exec logs in cmd-exec responses (Spike) Add a flag in the application.properties to enable/disable the display of cmd-exec responses on the BP side (Fix) Correction of BP processing with kafka regression (Fix) Changed default SSL Endpoint Algo Issue-ID: CCSDK-2326 Change-Id: If4d0e661117d1dd156cf19c95774824e754d870a Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2020-05-05fix sort at package listShaabanEltanany1-4/+8
Issue-ID: CCSDK-2320 Signed-off-by: ShaabanEltanany <shaaban.eltanany.ext@orange.com> Change-Id: Ia91d519c315b6ef0c01089422253599b137eceec
2020-04-30Fix null safety - ResourceResolutionDBService.writeJozsef Csongvai2-5/+29
Issue-ID: CCSDK-2352 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I49a56dff0636617111f02be141764600e0a1e082
2020-04-29RestResourceResolutionProcessor should always set StatusJozsef Csongvai1-0/+3
Issue-ID: CCSDK-2350 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: Ieadfb9b5931808f9eb298aa913d32cabbad67e2e
2020-04-28Merge "Making POD run as non-root"Dan Timoney1-1/+3
2020-04-24Merge "Secure Kafka Authentication"Dan Timoney17-187/+863
2020-04-23Making POD run as non-rootjananib1-1/+3
Non-root user addition Change-Id: Id110aebea3d3526aaf319d8994670644a7bab698 Issue-ID: CCSDK-2149 Signed-off-by: jananib <janani.b@huawei.com>
2020-04-21Secure Kafka AuthenticationJulien Fontaine17-187/+863
Implementation of kafka secure authentication : - SSL - SASL(SCRAM) & SSL Issue-ID: CCSDK-2313 Change-Id: I4b2fc7abab7478e360ebf461608a620d75708f54 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2020-04-20Merge "Fix default behavior for DatabaseResourceAssignmentProcessor"Dan Timoney3-73/+40
2020-04-16Fix default behavior for DatabaseResourceAssignmentProcessorJozsef Csongvai3-73/+40
If a data-dictionary did not declare an endpoint-selector, it would default to primary cds-db instead of using data-dictionary source to look up database configuration. Processor-db configurations were not used because of this. Also improved error messages and some refactoring. Issue-ID: CCSDK-2315 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I7122e1334951db4eec5b9ae8b01c1f66596636f6
2020-04-16Workflow-spec returning error responsejananib1-6/+21
Fix workflow-spec query Change-Id: Ic66e2249b73c113cd25bd99c9cf33984520e31df Issue-ID: CCSDK-2181 Signed-off-by: jananib <janani.b@huawei.com>
2020-04-15Making POD run as non-rootjananib1-0/+5
Non-root user addition Change-Id: I82995b0c0a6eb815e0422c6072c111c889c8c84a Issue-ID: CCSDK-2149 Signed-off-by: jananib <janani.b@huawei.com>
2020-04-10Merge "Publish execution input/output into Kafka topics"Dan Timoney10-60/+386
2020-04-10Merge "Enable inline templating in mapping files"Dan Timoney4-0/+53
2020-04-10Merge "Fix parsing error for RestResourceSource"Dan Timoney2-2/+3
2020-04-09Fix parsing error for RestResourceSourceJozsef Csongvai2-2/+3
Issue-ID: CCSDK-2310 Change-Id: I3587187b115797ce00ffd8c9125d9ee5035e25be Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2020-04-09Remove unneeded backup filesDan Timoney40-3464/+0
Remove unneeded backup files created by updParentVersion script Issue-ID: CCSDK-2308 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I8d76b8ee3ccb2dbe563f22aadf1125f8226a104f
2020-04-09Enable inline templating in mapping filesJozsef Csongvai4-0/+53
Issue-ID: CCSDK-2306 Change-Id: I9657eb73b48659edfc1adfd842ed96f35a095197 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2020-04-09Merge "Improving CMD-exec err msgs/handling."Dan Timoney1-16/+51
2020-04-08Publish execution input/output into Kafka topicsJulien Fontaine10-60/+386
- Creation and implementation of PublishAudit services (NoAudit,Kafka) - Conceal of sensitive data (request input parameters) - Update ExecutionServiceHandler tests - Update application.properties file Issue-ID: CCSDK-2183 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Ifc28a91ce588f5ed0010acb4ed22b64429c6c1a0
2020-04-08Improving CMD-exec err msgs/handling.Oleg Mitsura1-16/+51
Issue-ID: CCSDK-2049 rev1. initial commit rev2. added better logging/passing errors. rev3. bugfixes rev4. bugfix for CommandExecutorServer.prepareEnv return status was still returning bool. (was caught only during a defective mariadb pip package install!) Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: Ifbddaeb0e15857f42b121af10e30e29dec5c20b2
2020-04-08Merge "Refactoring BP Code with ErrorCatalog"Dan Timoney47-389/+578
2020-04-08Merge "Removed logging of configuration snapshot as it might leak sensitive ↵Dan Timoney1-1/+1
data in the logs."
2020-04-07Roll to next Guilin snapshotDan Timoney80-49/+3553
Roll to next Guilin snapshot release Issue-ID: CCSDK-2152 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I1a5ea68da8821ffe28ac84e60177af05e26b3585
2020-04-06Merge "execution timeout not respected..."Dan Timoney4-23/+43
2020-04-06Refactoring BP Code with ErrorCatalogBrinda Santh47-389/+578
Issue-ID: CCSDK-2124 Signed-off-by: Steve Siani <alphonse.steve.siani.djissitchi@ibm.com> Change-Id: Ief468a56f9e7b3ef86c357965aa7b15f0a4cfa22
2020-03-31Fix ResolutionSummary - return empty string instead of nullJozsef Csongvai3-18/+40
Issue-ID: CCSDK-2246 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I894bf605ee7f5b094d015fd637979ce055da5081