aboutsummaryrefslogtreecommitdiffstats
path: root/ms/blueprintsprocessor/modules/inbounds/selfservice-api
AgeCommit message (Collapse)AuthorFilesLines
2023-04-27Adding some minor featuresSingal, Kapil (ks220y)1-2/+2
* Adding proxy and ssl context to CloseableHttpClient * Adding paged capability to ResourceDictionary GET API, and adding POST APi to bulk load resource definitions * Adding more packages to swagger-maven-plugin to get more RestCOntroller generating swagger doc * Fixing maven artifact versions all places Issue-ID: CCSDK-3895 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I096f80a2326cd00068029330b241da209e46e31d (cherry picked from commit 2f4cc180555b1891fb749443449bd969db408d9c)
2023-04-07Add db connection status check as option for readiness healthcheckLukasz Rajewski1-3/+16
Issue-ID: CCSDK-3887 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@t-mobile.pl> Change-Id: I1e32dedc6abaf829fe82733548cb9c26ea386117
2023-01-04Use released version 2.5.1 parent pomsDan Timoney1-1/+0
Use released version 2.5.1 of parent pom Issue-ID: CCSDK-3831 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: Ic46287ef341abb1eb2bbdd68ecc890f80702b4a9
2022-10-28Update versions for LondonTimoney, Dan (dt5972)1-1/+2
Update version of master branch CDS for London relesae Issue-ID: CCSDK-3779 Signed-off-by: Timoney, Dan (dt5972) <dtimoney@att.com> Change-Id: I41a60427c902c731990a9cb570896551819959b6
2022-10-27Release version 1.4.1 maven artifactsTimoney, Dan (dt5972)1-1/+1
Release version 1.4.1 maven artifacts and roll to next snapshot Issue-ID: CCSDK-3777 Signed-off-by: Timoney, Dan (dt5972) <dtimoney@att.com> Change-Id: I37429e7e210a4620d4a2aed4618c501aa4836c02
2022-09-28Release version 1.4.0 CDS artifactsTimoney, Dan (dt5972)1-1/+1
Release version 1.4.0 of ccsdk/cds artifacts and roll to next snapshot Issue-ID: CCSDK-3754 Signed-off-by: Timoney, Dan (dt5972) <dtimoney@att.com> Change-Id: I2b3844a40f94885b3ad08847f6a8145950ac46e0
2022-06-07Improve log format consistencyJozsef Csongvai3-18/+23
Logs related to request processing should include: requestId, subrequestId and originatorId. Each API (rest,grpc,kafka) would produce different outputs, due to MDC context not being passed properly between coroutine contexts or values not being populated. Issue-ID: CCSDK-3686 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: Ibafdffd3409b9724ad91633ca5840070f7e287f5
2022-05-19Override Request ID in MDC ContextJulien Fontaine1-2/+1
Issue-ID: CCSDK-3676 Signed-off-by: kuldipr <kuldip.rai@amdocs.com> Change-Id: I6b0a816fcb40e149be1818f9edc9d4839f1a4cf6
2022-04-28Update versions for Kohn releaseDan Timoney1-1/+1
Update versions in master branch for Kohn release Issue-ID: CCSDK-3641 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I78cbfb5ec5175e87233f263422f7323b22d352de
2022-04-12Prevent stack overflow in BluePrintProcessingGRPCHandlerJozsef Csongvai1-5/+4
The overridden onError is called when a terminating error occurs in the stream, for example when the calling client crashes. It should not be handled the same way as CBA processing errors. Issue-ID: CCSDK-3496 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: Ib0aa416325a5b9708615e0ef9d9c602df24518b9
2022-03-29Release Jakarta M4 CDS maven artifactsDan Timoney1-1/+1
Release Jakarta M4 version of CDS maven artifacts and roll to next snapshot Issue-ID: CCSDK-3604 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I3335ce0e3f6995c350c5a87691e9922204a67dcb
2021-09-21Roll versions for JakartaDan Timoney1-2/+1
Roll versions to set up for Jakarta release Issue-ID: CCSDK-3470 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: Ia341d92b79acd758cc9d16f24a83399d1a8a1c5b
2021-09-16Release version 1.2.0 maven artifactsDan Timoney1-1/+1
Release version 1.2.0 maven artifacts for CDS and roll version Issue-ID: CCSDK-3444 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I3e5beebd0e2aedb7d6f69ad854af879c20308c17
2021-09-13Fix versionDan Timoney1-1/+1
Should use project.version property for internal references, not hard-coded value. Otherwise, staging and docker builds break. Issue-ID: CCSDK-3460 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I5e9ac3b302f7b3c8a7ce8bc6f166f1a4c56af4f5
2021-08-27CCSDK-3434 CBA workflow status storeKavitha P6-6/+88
Change-Id: Iaeac6fa534c569bbc152e6c8a78c2dd23b6c4b1a Signed-off-by: Kavitha P <pkavitha@aarnanetworks.com> Issue-ID: CCSDK-3434
2021-07-28Revert "Renaming Files having BluePrint to have Blueprint"Jozsef Csongvai15-112/+112
The renaming in CCSDK-3098 caused breaking changes to the grpc api and compile issues for kotlin scripts. Issue-ID: CCSDK-3385 Change-Id: I0d745cb858371678eabcb2284671c1fd76a1ab6d Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-04-28Add check for cluster status to readiness endpointJozsef Csongvai1-3/+14
When Cluster is enabled, BlueprintsProcessor should not process any requests until cluster is fully joined. Issue-ID: CCSDK-3275 Change-Id: I779159346976f7af0c0add69883f27d7f359f413 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-03-17Refactoring to enable on_failure for imperative workflowJozsef Csongvai2-7/+3
BlueprintError needs to associate errors with the steps in which they occurred in order for imperative workflow to handle on_failure properly. Made stepName more accessible and corrected places where stepName was assigned to nodeTemplateName. Issue-ID: CCSDK-3219 Change-Id: I7e5805745c63558cff6be533e1b99c32ad06c3db Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-03-16Assign a unique worker ID for CDS Kafka workerJulien Fontaine1-1/+1
* Modified CDS Kafka workers to add the 5 lasts characters of the env var HOSTNAME to their worker ID. * Small refactoring to move some utilitary functions to BlueprintMessageUtils Issue-ID: CCSDK-3204 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Iaacd35e9cbe4705d17548518040c679185eaf30a
2021-03-09Roll master version for IstanbulDan Timoney1-1/+1
Roll versions of ccskd parent poms to 2.2.0-SNAPSHOT and of ccsdk/cds to 1.2.0-SNAPSHOT for Istanbul release Issue-ID: CCSDK-3190 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: Iab0bf047c8d2e4ddaaadf2e6278917ed2de338e5
2021-03-04Release version 1.1.1 of CDS dockersDan Timoney1-1/+1
Release new CDS dockers to correct issues found with release 1.1.0 dockers. Issue-ID: CCSDK-3192 Issue-ID: CCSDK-3197 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I3bc1acbb93f0bb95ef14a6565e66d8da7a5df21d
2021-02-23Release version 1.1.0 docker containers and roll to next versionDan Timoney1-1/+1
Release version 1.1.0 docker containers and roll to next version Issue-ID: CCSDK-3179 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I2518ba1dd5a4bd926499867f5f9714bc3f716732
2021-02-11Added Kafka metrics for CDS workersJulien Fontaine5-32/+67
Added counters to gather metrics on CDS Kafka workers. This will enable us to get metrics on how many messages we consumer and produce to/from kafka. For consumers we count how many messages we consume and how many failed ie. consumed but not able to be processed (parsing error). For producers we count how many messages we produce and how many failed ie. failed to be pushed to the cluster (unavailable brokers, network error, ...). Relocated metrics tag constants to BlueprintConstants so that they can be use by any CDS module. If they make sense for other metrics then they should be shared. Issue-ID: CCSDK-3155 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Iad6aba588766f655f3a74cd626e0f74e29188f96
2021-02-11Improve logging for CDS Kafka workersJulien Fontaine2-16/+18
Modified CDS Kafka consumersand producers logs to provide more details about the topic of the consumer record being consumed or published. Refactored the publish callback to make it more readable. Refactored audit service log error messages. Issue-ID: CCSDK-3154 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I7b42930e926bc15ce175974a78d3bfe2f219b0a8
2021-01-22Renaming Files having BluePrint to have BlueprintKAPIL SINGAL13-90/+90
Replacing BluePrint with Blueprint throughout Issue-ID: CCSDK-3098 Signed-off-by: KAPIL SINGAL <ks220y@att.com> Change-Id: Ibee8bad07ae7d9287073db2d4f2f2cd730fa8b96
2020-12-16Fixing typo in message-prioritizationSingal, Kapil (ks220y)1-1/+1
Refactoring few POMs name tag Issue-ID: CCSDK-3053 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I14447ea7f93efcc970213bbe7d42663cb87e33d7
2020-10-28Blueprints Processor MetricsJulien Fontaine9-4/+140
Add counter and timer for Blueprints Processor process to get success/failure and execution time for each blueprint execution using blueprint name, version and action. Issue-ID: CCSDK-2950 Change-Id: I38e8997de26effe69ec2ee9e2b6ed0da14de4a43 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2020-09-22Roll to initial Honolulu versionDan Timoney1-1/+1
Roll to initial Honolulu version Issue-ID: CCSDK-2742 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I563033c6c93a4121219eaa1d7bb8a026e9e490d4
2020-09-22Enabling Code FormatterSingal, Kapil (ks220y)19-82/+117
Code Formatter was turned off due to java 11 migation Issue-ID: CCSDK-2852 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I3d02ed3cc7a93d7551fe25356512cfe8db1517d8
2020-09-11Refactoring poms groupId artifactIdSingal, Kapil (ks220y)1-8/+8
Issue-ID: CCSDK-2787 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: Ica64f0c793beabb47950c7bf1eede63a0dbf3cea
2020-09-02Adding parent pom referenceSingal, Kapil (ks220y)1-2/+1
Adding parent pom to cba-assembly-descriptor as it needs to inherit repository from parent so maven-deploy-plugin works Issue-ID: CCSDK-2720 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I44ce3721f280555b81475580ca47539ae83d07ca
2020-08-10Merge "Make use of Kafka Key for Audit service and Kafka listener"KAPIL SINGAL2-5/+9
2020-08-07Kafka Audit Service: Error during sensitive data hidingJulien Fontaine1-54/+118
Changed behaviour during sensitive data hiding. Instead of looking for every node template defined in the CBA we only check for the ones declared for the current executed workflow. This prevent the issue when you have two independant workflows defined in the same CBA and one of those has a node template using a get_input expression for template-prefix in a component-resource-resolution. If you execute the other workflow audit service was still trying to resolve this expression which was making it fail. Issue-ID: CCSDK-2636 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Ib232c26ebf930917e19e7970e1a56c15e676888f
2020-08-04Make use of Kafka Key for Audit service and Kafka listenerJulien Fontaine2-5/+11
* When message is sent by audit service, key will be the CBA name * When sent by kafka listener (self-service api), key is the same as the request message key consumed. If not specified, a random UUID * MessageProducer interface refactoring : * add 'key' parameter to specify a key * add default value null to paramater 'headers' to remove some unnecessary method Issue-ID: CCSDK-2628 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I68580151184c87104c07037f379276dd8c8c71c7
2020-07-24Change EventListener functions to non-blocking scopeJozsef Csongvai1-1/+2
BluePrintProcessingKafkaConsumer and BluePrintProcessorCluster were both defining EventListener functions which were executed with runBlocking. When both were enabled, kafkaconsumer would block and cluster would never run. Issue-ID: CCSDK-2609 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I91813208f0474869f174da6c99280b5159859232
2020-06-22Kafka Audit Service : Improve error handling and miscellaneous refactoringJulien Fontaine5-87/+96
When Kafka Audit Service fails it no longer stops Blueprint Processor execution * Add error handling when trying to hide sensitive data * Add error handling when trying to send kafka message * Set timeout for blocking loop when sending messages with kafka producer -> When broker is not available producer tries to reconnect in a blocking loop * Refactor Audit Service interface to give more explict name for publish methods * Modify publishExecutionOutput() to a non-blocking function Issue-ID: CCSDK-2459 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I809a5f34f81889aa9eed499608348f149984bc38
2020-06-19Error when template-prefix-names list is set as an inputJulien Fontaine1-1/+12
Case when template-prefix-names list for resource resolution is passed as an input was not handled. When the audit service was trying to get input-prefix-names values he was only getting {"get_input": "..."} and was not resolving this expression. Issue-ID: CCSDK-2456 Change-Id: If9ebbf0aa6b6eae3e44a7bfe0b930f622dfd3c1e Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2020-05-13Kafka Audit Service : Error with CBA using dg-generic node templateJulien Fontaine1-27/+35
* Fixed issue with dg-generic node template * Changed behaviour for hiding sensitive data -> Instead of just checking the node-template targeted by the workflow, we check every node-template declared in the CBA. If we find one or more component-resource-resolution node-template, we verify if we need to hide sensitive data in the kafka message. Issue-ID: CCSDK-2372 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I079ee29ae532b3947cdc8efe3438678309ca50b7
2020-05-11Kafka Audit Service : CorrelationUUID from request is not matching the ↵Julien Fontaine5-9/+7
correct response in Kafka Moved out CorrelationUUID linking between the request and the response from the Kafka Audit Service to the ExecutionServiceHandler. This prevents the race condition happening when several ExecutionServiceOutputs try to set the CorrelationUUID related to their ExecutionServiceInput. Issue-ID: CCSDK-2370 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I0c5934d4486961fbfcb34fd2d2492cd843350025
2020-05-05Truncate message published on Kafka / Spike: Define solution for logs separationJulien Fontaine2-10/+25
Refactoring of cmd-exec component - Improve display of error messages within the response - Fix gRPC buffer limitation (4Mb) by truncating error messages and cmd-exec logs if too heavy (>3Mb) Truncation of BP responses (<4Kb) before sending them in kafka audit topics. - Truncation if needed of error messages for every response - Truncation of cmd-exec logs in cmd-exec responses (Spike) Add a flag in the application.properties to enable/disable the display of cmd-exec responses on the BP side (Fix) Correction of BP processing with kafka regression (Fix) Changed default SSL Endpoint Algo Issue-ID: CCSDK-2326 Change-Id: If4d0e661117d1dd156cf19c95774824e754d870a Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2020-04-21Secure Kafka AuthenticationJulien Fontaine3-1/+12
Implementation of kafka secure authentication : - SSL - SASL(SCRAM) & SSL Issue-ID: CCSDK-2313 Change-Id: I4b2fc7abab7478e360ebf461608a620d75708f54 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2020-04-10Merge "Publish execution input/output into Kafka topics"Dan Timoney7-46/+349
2020-04-09Remove unneeded backup filesDan Timoney1-81/+0
Remove unneeded backup files created by updParentVersion script Issue-ID: CCSDK-2308 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I8d76b8ee3ccb2dbe563f22aadf1125f8226a104f
2020-04-08Publish execution input/output into Kafka topicsJulien Fontaine7-46/+349
- Creation and implementation of PublishAudit services (NoAudit,Kafka) - Conceal of sensitive data (request input parameters) - Update ExecutionServiceHandler tests - Update application.properties file Issue-ID: CCSDK-2183 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Ifc28a91ce588f5ed0010acb4ed22b64429c6c1a0
2020-04-08Merge "Refactoring BP Code with ErrorCatalog"Dan Timoney12-21/+122
2020-04-07Roll to next Guilin snapshotDan Timoney2-1/+83
Roll to next Guilin snapshot release Issue-ID: CCSDK-2152 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I1a5ea68da8821ffe28ac84e60177af05e26b3585
2020-04-06Refactoring BP Code with ErrorCatalogBrinda Santh12-21/+122
Issue-ID: CCSDK-2124 Signed-off-by: Steve Siani <alphonse.steve.siani.djissitchi@ibm.com> Change-Id: Ief468a56f9e7b3ef86c357965aa7b15f0a4cfa22
2020-03-30Roll to next Frankfurt snapshot and fix sonar buildDan Timoney1-1/+1
Roll to next Frankfurt snapshot. Also, fixed config to skip sonar for error-catalog, which has no scannable components. Sonar builds were failing because error-catalog does not have standard maven source and test directories (src/main, src/test) Issue-ID: CCSDK-2152 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: Iacb76b240e71206de8306af7e2447eaa07b0d33b
2020-03-18Fix GroupId and package name in Error CatalogDan Timoney1-1/+1
Issue-ID: CCSDK-2180 Signed-off-by: Steve Siani <alphonse.steve.siani.djissitchi@ibm.com> Change-Id: Ibe00fc1f2a905821b7100ae4f221ea1e0b934894
2020-03-11Error Catalog Management Core Library.Brinda Santh2-1/+49
Issue-ID: CCSDK-2076 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I9e8e67bdee77fb359a791f4ef4c2963aa78ab93a Signed-off-by: Steve Siani <alphonse.steve.siani.djissitchi@ibm.com>