aboutsummaryrefslogtreecommitdiffstats
path: root/ms/blueprintsprocessor/modules
AgeCommit message (Collapse)AuthorFilesLines
2020-05-05Truncate message published on Kafka / Spike: Define solution for logs separationJulien Fontaine6-18/+79
Refactoring of cmd-exec component - Improve display of error messages within the response - Fix gRPC buffer limitation (4Mb) by truncating error messages and cmd-exec logs if too heavy (>3Mb) Truncation of BP responses (<4Kb) before sending them in kafka audit topics. - Truncation if needed of error messages for every response - Truncation of cmd-exec logs in cmd-exec responses (Spike) Add a flag in the application.properties to enable/disable the display of cmd-exec responses on the BP side (Fix) Correction of BP processing with kafka regression (Fix) Changed default SSL Endpoint Algo Issue-ID: CCSDK-2326 Change-Id: If4d0e661117d1dd156cf19c95774824e754d870a Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2020-04-24Merge "Secure Kafka Authentication"Dan Timoney14-169/+806
2020-04-21Secure Kafka AuthenticationJulien Fontaine14-169/+806
Implementation of kafka secure authentication : - SSL - SASL(SCRAM) & SSL Issue-ID: CCSDK-2313 Change-Id: I4b2fc7abab7478e360ebf461608a620d75708f54 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2020-04-20Merge "Fix default behavior for DatabaseResourceAssignmentProcessor"Dan Timoney2-70/+37
2020-04-16Fix default behavior for DatabaseResourceAssignmentProcessorJozsef Csongvai2-70/+37
If a data-dictionary did not declare an endpoint-selector, it would default to primary cds-db instead of using data-dictionary source to look up database configuration. Processor-db configurations were not used because of this. Also improved error messages and some refactoring. Issue-ID: CCSDK-2315 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I7122e1334951db4eec5b9ae8b01c1f66596636f6
2020-04-16Workflow-spec returning error responsejananib1-6/+21
Fix workflow-spec query Change-Id: Ic66e2249b73c113cd25bd99c9cf33984520e31df Issue-ID: CCSDK-2181 Signed-off-by: jananib <janani.b@huawei.com>
2020-04-10Merge "Publish execution input/output into Kafka topics"Dan Timoney8-47/+354
2020-04-09Remove unneeded backup filesDan Timoney26-1631/+0
Remove unneeded backup files created by updParentVersion script Issue-ID: CCSDK-2308 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I8d76b8ee3ccb2dbe563f22aadf1125f8226a104f
2020-04-08Publish execution input/output into Kafka topicsJulien Fontaine8-47/+354
- Creation and implementation of PublishAudit services (NoAudit,Kafka) - Conceal of sensitive data (request input parameters) - Update ExecutionServiceHandler tests - Update application.properties file Issue-ID: CCSDK-2183 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Ifc28a91ce588f5ed0010acb4ed22b64429c6c1a0
2020-04-08Merge "Refactoring BP Code with ErrorCatalog"Dan Timoney42-385/+544
2020-04-07Roll to next Guilin snapshotDan Timoney52-28/+1685
Roll to next Guilin snapshot release Issue-ID: CCSDK-2152 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I1a5ea68da8821ffe28ac84e60177af05e26b3585
2020-04-06Merge "execution timeout not respected..."Dan Timoney2-14/+16
2020-04-06Refactoring BP Code with ErrorCatalogBrinda Santh42-385/+544
Issue-ID: CCSDK-2124 Signed-off-by: Steve Siani <alphonse.steve.siani.djissitchi@ibm.com> Change-Id: Ief468a56f9e7b3ef86c357965aa7b15f0a4cfa22
2020-03-31Fix ResolutionSummary - return empty string instead of nullJozsef Csongvai1-9/+9
Issue-ID: CCSDK-2246 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I894bf605ee7f5b094d015fd637979ce055da5081
2020-03-30Roll to next Frankfurt snapshot and fix sonar buildDan Timoney26-28/+28
Roll to next Frankfurt snapshot. Also, fixed config to skip sonar for error-catalog, which has no scannable components. Sonar builds were failing because error-catalog does not have standard maven source and test directories (src/main, src/test) Issue-ID: CCSDK-2152 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: Iacb76b240e71206de8306af7e2447eaa07b0d33b
2020-03-30execution timeout not respected...Oleg Mitsura2-14/+16
Issue-ID: CCSDK-2012 rev1: initial commit rev2: reworked + added grpc deadline rev3: wrong err msg.. rev4: timeouts in millis rev5: timeout defaulting was after logging... Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: I02eb414904cc5dfcf51ff7b7552dafe54857ed1e (cherry picked from commit 3f56fcfec7d14e7351280b9e2a1d220638626693)
2020-03-19Fix kotlin cache lazy loadingSebastien Premont-Tendland5-12/+18
When USE_SCRIPT_COMPILATION_CACHE is set to false the classLoader is closed after the class is instantiated. This is causing an issue when lazy loading is happening during the script execution. Lazy loading occurs when a suspendible function returning something is called from "processNB", kotlin will create a second class that will be loaded during execution (needs to be in the classpath during execution). Issue-ID: CCSDK-2150 Signed-off-by: Sebastien Premont-Tendland <sebastien.premont@bell.ca> Change-Id: I64780287352d762325662e0e5d5b94038dedee7f
2020-03-18Fix GroupId and package name in Error CatalogDan Timoney4-7/+6
Issue-ID: CCSDK-2180 Signed-off-by: Steve Siani <alphonse.steve.siani.djissitchi@ibm.com> Change-Id: Ibe00fc1f2a905821b7100ae4f221ea1e0b934894
2020-03-13Merge "add a rest endpoint to remove resources"KAPIL SINGAL1-0/+22
2020-03-11Error Catalog Management Core Library.Brinda Santh7-45/+239
Issue-ID: CCSDK-2076 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I9e8e67bdee77fb359a791f4ef4c2963aa78ab93a Signed-off-by: Steve Siani <alphonse.steve.siani.djissitchi@ibm.com>
2020-03-09add a rest endpoint to remove resourcesJulien Fontaine1-0/+22
Issue-ID: CCSDK-2159 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I504fa0aad6f4e7105a53e793d08d08d92bbb8df4
2020-03-03Add properties to ResolutionSummaryJozsef Csongvai1-3/+7
Also wrapping ResolutionSummary response to ease integration with SDNC. Issue-ID: CCSDK-2038 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: Ic1b8959e22ef795065d37664fb60f100af235a90
2020-03-03Add override function to BlueprintSvcLogicServiceJozsef Csongvai1-0/+4
Issue-ID: CCSDK-2153 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I58f807fbfea85880f3c2b9443ed62a1d84f0f6bb
2020-02-26API for list of workflow and I/O for a workflow namejananib4-0/+138
REST API for CDS workflow Issue-ID: CCSDK-422 Change-Id: Ia26287214941a20287c810dc27c030d974a8847a Signed-off-by: jananib <janani.b@huawei.com>
2020-02-26Merge SW Upgrade Blueprint into PNF_AAI and create one UAT BP for PNFgummar2-3/+8
UAT: Add support to multiple responses for a single request Set property IN_UAT=1 during UAT execution so blueprints can tune their settings to values more suitable for testing (like timeouts) Add 'times' field to specify expected number of invocations Add UAT blueprint script for PNF SW Upgrade UC Add current thread check for Hazelcast distributed lock Resolve URI before returning Issue-ID: CCSDK-2091 Change-Id: Id256bad043488f88f1b60015ebf9ade4be607fa2 Signed-off-by: gummar <raj.gumma@est.tech>
2020-02-25Merge "Fix Sonar Jenkins job"Dan Timoney1-0/+4
2020-02-25Changed the default multicast address.Sebastien Premont-Tendland6-69/+30
There's an issue with macOS when docker is installed and a multicast address different than 224.0.0.1 is used. https://stackoverflow.com/questions/46341715/hazelcast-multicast-does-not-work-because-of-vboxnet-which-is-used-by-docker-mac Re-organized the test hazelcast yaml since we now fill the cluster-name and instance-name information from the ClusterInfo object during creation. No need to pass it in the config file anymore. This is causing every file to be the exact same thus the consolidation. Also fix an issue with test case using the same hazelcast service in two different threads causing intermittent issue during the build process. Issue-ID: CCSDK-2119 Signed-off-by: Sebastien Premont-Tendland <sebastien.premont@bell.ca> Change-Id: I7f8328bfd93cdcabe8ab2fa844cbf9dd57f1493a
2020-02-25Fix Sonar Jenkins jobDan Timoney1-0/+4
Updated pom.xmls of modules that do not contain 'src/main' directory to skip Sonar scan. This allows Sonar scan to complete for the rest of CDS. Need to revisit these modules to see whether they should really be skipped or if sonar properties (e.g. sonar.sources) should instead be tailored. Issue-ID: CCSDK-2116 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I8b0237886e357a0188633f007dc97cf6e725fa53
2020-02-24Add tar.gz compression capabilityLukasz Rajewski2-36/+154
The change modifies ArchiveUtils by change of the library responsible for compression and decompression of zip files. After change of library for appache compression tar.gz was added as another format which archive utils can support. For ZIP files there is kept backward compatibility because new lib keeps implementation of ZipFile similar to the one used before in the utils. Issue-ID: INT-1458 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@orange.com> Change-Id: I78388ef8c5e7a23ac6664ae49c00638af38d8c8a
2020-02-24Merge "Cleaning up blueprint processor parent pom"KAPIL SINGAL1-0/+6
2020-02-21Eliminate Template RequirementJozsef Csongvai4-9/+37
Enables resource assignment without the use of a template. If no template is defined by the CBA, the default output is a kev-value map. If operation input: resolution-summary is set to true, output will be a list of ResolutionSummary. Issue-ID: CCSDK-2038 Change-Id: I5f6bcefcacec6e83cffac1134b13690b500a7563 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2020-02-20Cleaning up blueprint processor parent pomSingal, Kapil (ks220y)1-0/+6
Removing dependencies which are being inheritted from ccsdk/parent spring-boot-parent-pom -> dependency-bom Issue-ID: CCSDK-2110 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I8e07ca9887f0378985b21ddb146c53413bdfc592
2020-02-18Add ability to resolve environment variables when readingSebastien Premont-Tendland1-5/+3
PrimaryDatabaseConfiguration This is needed to remove hardcoded password in application.properties file by being able to resolve environment variables. OOM would pass the username and password through environment variables. Issue-ID: CCSDK-2095 Signed-off-by: Sebastien Premont-Tendland <sebastien.premont@bell.ca> Change-Id: Ia19ef0ddee29509b0378b048bf58c700870ecce4
2020-02-17Removed manual shutdown hook for hazelcastSebastien Premont-Tendland1-3/+5
Shutdown hook for hazelcast are already working with spring boot. Just changed the policy to GRACEFUL (default is TERMINATE). This allow hazelcast to shutdown gracefully and recover from a rolling upgrade Also updated the Dockerfile to use multi stage to reduce by ~200Mb the docker image size. Issue-ID: CCSDK-2011 Signed-off-by: Sebastien Premont-Tendland <sebastien.premont@bell.ca> Change-Id: I0034145c7acefa88ed8d16f23a29249c7225ace3
2020-02-14Cluster CP member promotion as default.Brinda Santh7-5/+151
Issue-ID: CCSDK-2011 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I4df4b442c020fbf9da294a9b35739ca3acb8ee02
2020-02-12Refactoring Resource Resolution ServiceSingal, Kapil (ks220y)2-5/+7
Removing Node Template dependency Issue-ID: CCSDK-2078 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I24f3e003c64f3ee40eee4699366cfadfc1d7147e
2020-02-12Cluster co-ordination with Hazelcast.Brinda Santh19-553/+632
Remove Atomix implementation, due to Kubernetes clustering issues. Cluster environment property changes. Issue-ID: CCSDK-2011 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I23f40c92c0adc6b3ab8690871385f78525c76433
2020-02-01Expose rest API with non blocking call.Brinda Santh6-126/+182
Convert Mono and Flux to coroutines Convert reactor mdc to coroutine mdc Issue-ID: CCSDK-2052 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: Ic58c0b74866d28fd2d803b96626b08f8e8b2db56
2020-01-31Spring boot, Kotlin version upgradesBrinda Santh10-18/+13
Dependent Patch : https://gerrit.onap.org/r/c/ccsdk/parent/+/100990 Fixed Jackson set method according to latest version. Fixed Security properties issues for failed JUnit test cases. Reused maven properties from parent for Spring boot, Nats, Kafka, etc Issue-ID: CCSDK-1737 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I04bb0e535161e05897f587a0f08a2689e10c5f41
2020-01-22Enhancement better error messages.Oleg Mitsura2-4/+33
Issue-ID: CCSDK-2036 rev1: initial commit. Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: I0bc31a2a17a6dfedbb1870470e8bf6304be782b5
2020-01-17Fix scheduler shutdown config function.Brinda Santh2-4/+2
Optimize application name accessing in Docker Compose. Issue-ID: CCSDK-1917 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I6b055de7ef5a8ac4a0c103499997ed272bd74ac6
2020-01-16Prioritization Optional NATS consumer supportBrinda Santh9-8/+127
Add prioritization NATS consumer service and configuration data beans. Optimizing message prioritization service interface. Added Integration testing for NATS simulation. Updated sample docker compose for NATS support Issue-ID: CCSDK-1917 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: Icd21e5e2ab7b64d6e6e4b0610599ca947555ee15
2020-01-13Prioritization expiry and clean scheduler serviceBrinda Santh1-0/+9
Add prioritization expiry and clean scheduler service implementation. Optimizing message passing between processors. Added message sorting utils. Issue-ID: CCSDK-1917 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I049ea3bae2e2c546244136f15c3d89deda1e7053
2020-01-13Add uri-encoding to webclientJozsef Csongvai1-6/+9
Path params are not uri-encoded, which can cause failed rest calls if resolved params include characters such as whitespace Issue-ID: CCSDK-2024 Change-Id: Iac57219260ac94897e09e3cb9d1d5884d86b83ae Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2020-01-08Merge "Add new endpoint for posting data-dictinary as ResourceDefinition"Brinda Santh Muthuramalingam4-25/+109
2020-01-08Add new endpoint for posting data-dictinary as ResourceDefinitionJozsef Csongvai4-25/+109
Starter-dictionaries and examples in the documentation have the type ResourceDefinition. The existing endpoint accepts ResourceDictionary which is the wrapping entity of ResourceDefinition. Issue-ID: CCSDK-1725 Change-Id: I07f925ba4f607a6eaecf5907ac6e08691578c3b5 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2020-01-08Rest endpoint for message PrioritizationBrinda Santh1-0/+8
Refactored to support both Kafka and Rest endpoint prioritization. Simplified number for Kafka processors. Issue-ID: CCSDK-1917 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: Iba77ed94be3398940840ff01a298f0bec785401f
2020-01-07Include correlationId in group lock.Brinda Santh2-14/+37
Message prioritization optimization by checking and including correlation Id, so that non related correlation message won't get locked. Optimized Atomix Junit Test cases. Issue-ID: CCSDK-2011 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I090ed4c193c7f9af4014cfeee4c6208c12b542c1
2020-01-02Message Prioritization message group lock.Brinda Santh2-0/+8
Implementation to avoid concurrent procession of message group while prioritization. Sample message prioritization Kafka listener properties. Issue-ID: CCSDK-2011 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: Ifbf39985b03c662b6ccf7740be711cfeb7bfbebb
2019-12-31Flexible DSL Types and Templates definition.Brinda Santh20-104/+423
Easy search definitions Types and Templates inside ServiceTemplate DSL builder. Unit test modifications to support this change. Issue-ID: CCSDK-1054 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: Ie944ff5f75f80c852555306e1a4e0fa7f5b803d7