aboutsummaryrefslogtreecommitdiffstats
path: root/ms/blueprintsprocessor/modules/commons
AgeCommit message (Collapse)AuthorFilesLines
2023-04-26Adding some minor featuresSingal, Kapil (ks220y)2-1/+22
* Adding proxy and ssl context to CloseableHttpClient * Adding paged capability to ResourceDictionary GET API, and adding POST APi to bulk load resource definitions * Adding more packages to swagger-maven-plugin to get more RestCOntroller generating swagger doc * Fixing maven artifact versions all places Issue-ID: CCSDK-3895 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I096f80a2326cd00068029330b241da209e46e31d
2023-03-31K8sPlugin: support UAT functionalityFrank Kimmlingen2-26/+56
K8sAbstractRestClientService and all derived classes K8sQueryRestClient K8sRbInstanceRestClient K8sDefinitionRestClient K8sUploadFileRestClientService does not support the spy / verify functionality of UatExecutor / UatServices Issue-ID: CCSDK-3872 Signed-off-by: Frank Kimmlingen <frank.kimmlingen@telekom.de> Change-Id: Iee30f48e9d86efd07a2ab6dde0d5743e4657934f (cherry picked from commit 97c07491d6dfb1fca6e4aeebaf7318324c1d3eb4)
2023-03-14Enable JUnit testsFrank Kimmlingen2-0/+10
JUnit tests are no more executed: spring-boot-starter-test does not execute any junit4 tests by default Issue-ID: CCSDK-3859 Signed-off-by: Frank Kimmlingen <frank.kimmlingen@telekom.de> Signed-off-by: Lukasz Rajewski <lukasz.rajewski@t-mobile.pl> Change-Id: I02a8d25350ca62262bfc6e07c2865cd8d7b4e6b2
2022-12-19Release version 1.4.2 CDS maven artifactsDan Timoney9-9/+9
Release version 1.4.2 CDS maven artifacts and roll to next snapshot Issue-ID: SDNC-1765 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: Iedfba4f5543a95f0e8ba1f45c4511d58b195ffba
2022-10-27Release version 1.4.1 maven artifactsTimoney, Dan (dt5972)9-9/+9
Release version 1.4.1 maven artifacts and roll to next snapshot Issue-ID: CCSDK-3777 Signed-off-by: Timoney, Dan (dt5972) <dtimoney@att.com> Change-Id: I37429e7e210a4620d4a2aed4618c501aa4836c02
2022-10-25Add Rest client that do not add any default headersLukasz Rajewski6-12/+153
In consequence we can specify client without default headers. Still, we can specify additional headers in the client properties. We can use data disctionary definition to add extra headers. Sice Kohn we can also template the headers section in the data dictionary so ssuch headers can be created dynamically. Issue-ID: CCSDK-3787 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@t-mobile.pl> Change-Id: I14c219251e11733c7cdfe059c87717f6b0fded0d
2022-10-22Upgrade spring boot parent and hazelcastJozsef Csongvai3-3/+3
The code changes are required for kotlin upgrade. New kotlin version is 1.5.32 (defined in spring-boot-parent) Issue-ID: CCSDK-3701 Issue-ID: CCSDK-3762 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I0d6ecc7bee8c21d2ecd3ac4364845c5c8e0e9738
2022-10-06UATExecutor support for k8sConnectionPluginLukasz Rajewski1-0/+8
Issue-ID: CCSDK-3785 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@t-mobile.pl> Change-Id: Ice34d61ac62fe8935a6df539376dcbb9e998beaf
2022-09-28Release version 1.4.0 CDS artifactsTimoney, Dan (dt5972)9-9/+9
Release version 1.4.0 of ccsdk/cds artifacts and roll to next snapshot Issue-ID: CCSDK-3754 Signed-off-by: Timoney, Dan (dt5972) <dtimoney@att.com> Change-Id: I2b3844a40f94885b3ad08847f6a8145950ac46e0
2022-09-01Http 204 response results with exception in rest resolutionFrank Kimmlingen2-3/+92
Issue-ID: CCSDK-3746 Signed-off-by: Frank Kimmlingen <frank.kimmlingen@telekom.de> Change-Id: I740c970de631e58902e6f92b9069aee8d3ae075b
2022-08-24Refactor rest clients and support timeoutsLukasz Rajewski6-312/+384
- Refactored rest clients to remove redundant code - Timeouts added to the configuration of rest clients Issue-ID: CCSDK-3716 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@t-mobile.pl> Change-Id: I706b8efd8447570455b8b65bd5b1a22da474f62b
2022-08-04Kafka producer parameters updated to be consistent with frankfurtOleg Mitsura2-6/+6
Issue-ID: CCSDK-3737 Signed-off-by: kuldipr <kuldip.rai@amdocs.com> Change-Id: I00cba2f644abf85778abf17ee3fb9e102ac5f42f
2022-06-07Improve log format consistencyJozsef Csongvai4-0/+44
Logs related to request processing should include: requestId, subrequestId and originatorId. Each API (rest,grpc,kafka) would produce different outputs, due to MDC context not being passed properly between coroutine contexts or values not being populated. Issue-ID: CCSDK-3686 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: Ibafdffd3409b9724ad91633ca5840070f7e287f5
2022-05-23Merge "CCSDK-3671 add workflows list for grpc"Dan Timoney5-10/+48
2022-05-19Override Request ID in MDC ContextJulien Fontaine1-2/+15
Issue-ID: CCSDK-3676 Signed-off-by: kuldipr <kuldip.rai@amdocs.com> Change-Id: I6b0a816fcb40e149be1818f9edc9d4839f1a4cf6
2022-05-19CCSDK-3671 add workflows list for grpcOleg Mitsura5-10/+48
Issue-ID: CCSDK-3671 1. added grpc 'getWorkflows' for BlueprintManagement 2. during CBA upload, the workflows get cached to BLUEPRINT_MODEL.workflows 3. reworked HTTP endpoint to use above "/workflows/blueprint-name/{name}/version/{version}" 4. If CDS is upgraded, with existing CBAs present, fallback by parsing the CBA instead of DB lookup Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: I68bebfe23c0b16ea288512f1087bfe1ceef57686
2022-05-16Re-enable formatting and fix formatting issuesJozsef Csongvai2-5/+4
Issue-ID: CCSDK-3657 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: Idd1871e82a319325b042c339741a66c06499692c
2022-04-28Update versions for Kohn releaseDan Timoney9-9/+9
Update versions in master branch for Kohn release Issue-ID: CCSDK-3641 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I78cbfb5ec5175e87233f263422f7323b22d352de
2022-03-29Release Jakarta M4 CDS maven artifactsDan Timoney9-9/+9
Release Jakarta M4 version of CDS maven artifacts and roll to next snapshot Issue-ID: CCSDK-3604 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I3335ce0e3f6995c350c5a87691e9922204a67dcb
2022-03-02DMAAP-1706 - New Kafka Auth optiondavid.mcweeney5-1/+192
Change-Id: I8533721d23d6adb41f65cb96fb2b8f852bda47b8 Signed-off-by: david.mcweeney <david.mcweeney@est.tech> Issue-ID: DMAAP-1706
2021-11-30CCSDK-3531 improve cmd-exec returned err msgOleg Mitsura1-1/+2
Issue-ID: CCSDK-3531 Improve end-user CBA's Python scripts ability to return error messages on failues. See JIRA story for examples: https://jira.onap.org/browse/CCSDK-3531 adds functions send_response_err_msg(err_message) and send_response_err_msg_and_exit(ret_err_msg, code=1) Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: Ideda64dd108f987c3c4515c70daf9f7b6d2b1f2f
2021-09-21Roll versions for JakartaDan Timoney9-18/+9
Roll versions to set up for Jakarta release Issue-ID: CCSDK-3470 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: Ia341d92b79acd758cc9d16f24a83399d1a8a1c5b
2021-09-16Release version 1.2.0 maven artifactsDan Timoney9-9/+9
Release version 1.2.0 maven artifacts for CDS and roll version Issue-ID: CCSDK-3444 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I3e5beebd0e2aedb7d6f69ad854af879c20308c17
2021-09-10Upgrading velocity version to v2.3 due to some vulnerabilities in previous ↵meriem zidane1-1/+1
version Issue-ID: CCSDK-3430 Signed-off-by: Meriem Zidane <meriem.zidane@bell.ca> Change-Id: I82dad1c2dd7f8e4cc5712e9fddde5b1bb5429b7f
2021-08-31Upgrade hazelcast versionmeriem zidane1-1/+1
Upgrade hazelcast version from 4.0.3 to 4.2.2 Issue-ID: CCSDK-3429 Signed-off-by: meriem zidane <meriem.zidane@bell.ca> Change-Id: I560e3970f84210d3c0e8c8f5eb569b5f2cf556e0
2021-07-28Revert "Renaming Files having BluePrint to have Blueprint"Jozsef Csongvai96-630/+630
The renaming in CCSDK-3098 caused breaking changes to the grpc api and compile issues for kotlin scripts. Issue-ID: CCSDK-3385 Change-Id: I0d745cb858371678eabcb2284671c1fd76a1ab6d Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-06-23Add Request ID and Sub Request ID to CDS kafka logsJulien Fontaine3-22/+23
Improved log message when a message is published or consumed by CDS Kafka to specify the RequestID and SubRequestID. Issue-ID: CCSDK-3348 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I50e068d9aa36df8fe4ee5f0f6a8e9bd7a1209467
2021-05-13Add MS SQL driver in CDS blueprints andPrudence Au5-1/+77
DB resolution fails on an empty dataset with required template mapping. Issue-ID: CCSDK-3293 Issue-ID: CCSDK-3294 Signed-off-by: Prudence Au <prudence.au@amdocs.com> Change-Id: I9f302d12e7359b62180fcdfddbd8ae2c993a8324
2021-04-28Fixed error when uploading CBA when Hazelcast cluster is not initializedJulien Fontaine1-4/+2
Hazelcast is used to enable CDS pods to notify the rest of the CDS cluster when a CBA got updated locally so they clean their compile cache (if they have an entry for that CBA). Though, the code doesn't make sure that hazelcast cluster is fully initialized before trying to notify using a hazelcast topic. Fixed that error by making sure that the cluster is fully initialized before pushing notification to hazelcast topic. Issue-ID: CCSDK-3277 Change-Id: I44211c63c5a991269005bcc238f18b19979cb718 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2021-04-07Remove trust all for BasicAuthRestClientServiceClaudio D. Gasparini1-18/+0
following global requirement expected in Istanbul, which forbids disabling host name verification Issue-ID: CCSDK-3245 Signed-off-by: Claudio D. Gasparini <claudio.gasparini@intl.att.com> Change-Id: I89c37a94cb3999a8f1813d3fc33958421b183de1
2021-03-25Address some pendings items for SSLBasicAuthRestClientClaudio D. Gasparini5-27/+50
- FIXME under SSLBasicAuthRestClientProperties - TODO under SSLBasicAuthRestClientPropertiesBuilder Issue-ID: CCSDK-3235 Signed-off-by: Claudio D. Gasparini <claudio.gasparini@intl.att.com> Change-Id: If00c7491573c69eb5d3f9192f54c7b384943abf7
2021-03-23Fix Certificate Exception when using BasicAuthRestClientServiceClaudio D. Gasparini1-0/+18
by using TrustAllStrategy Issue-ID: CCSDK-3234 Signed-off-by: Claudio D. Gasparini <claudio.gasparini@intl.att.com> Change-Id: I7ee63739b4f1d7a4ddbc618ba660704aa058752a
2021-03-16Assign a unique worker ID for CDS Kafka workerJulien Fontaine6-36/+112
* Modified CDS Kafka workers to add the 5 lasts characters of the env var HOSTNAME to their worker ID. * Small refactoring to move some utilitary functions to BlueprintMessageUtils Issue-ID: CCSDK-3204 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Iaacd35e9cbe4705d17548518040c679185eaf30a
2021-03-09Roll master version for IstanbulDan Timoney9-9/+9
Roll versions of ccskd parent poms to 2.2.0-SNAPSHOT and of ccsdk/cds to 1.2.0-SNAPSHOT for Istanbul release Issue-ID: CCSDK-3190 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: Iab0bf047c8d2e4ddaaadf2e6278917ed2de338e5
2021-03-04Release version 1.1.1 of CDS dockersDan Timoney9-9/+9
Release new CDS dockers to correct issues found with release 1.1.0 dockers. Issue-ID: CCSDK-3192 Issue-ID: CCSDK-3197 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I3bc1acbb93f0bb95ef14a6565e66d8da7a5df21d
2021-02-23Release version 1.1.0 docker containers and roll to next versionDan Timoney9-9/+9
Release version 1.1.0 docker containers and roll to next version Issue-ID: CCSDK-3179 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I2518ba1dd5a4bd926499867f5f9714bc3f716732
2021-02-11Added Kafka metrics for CDS workersJulien Fontaine9-12/+156
Added counters to gather metrics on CDS Kafka workers. This will enable us to get metrics on how many messages we consumer and produce to/from kafka. For consumers we count how many messages we consume and how many failed ie. consumed but not able to be processed (parsing error). For producers we count how many messages we produce and how many failed ie. failed to be pushed to the cluster (unavailable brokers, network error, ...). Relocated metrics tag constants to BlueprintConstants so that they can be use by any CDS module. If they make sense for other metrics then they should be shared. Issue-ID: CCSDK-3155 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Iad6aba588766f655f3a74cd626e0f74e29188f96
2021-02-11Improve logging for CDS Kafka workersJulien Fontaine2-12/+29
Modified CDS Kafka consumersand producers logs to provide more details about the topic of the consumer record being consumed or published. Refactored the publish callback to make it more readable. Refactored audit service log error messages. Issue-ID: CCSDK-3154 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I7b42930e926bc15ce175974a78d3bfe2f219b0a8
2021-01-26PV/PVC eliminationOleg Mitsura3-2/+38
Issue-ID: CCSDK-3086 1. initial commit 2. fix accidental paste / rebased cleaned up unneeded validation call in cmd-exec upload Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: Ife5460c5be59aa8d8592d82099b27c507b08c6c6
2021-01-22Renaming Files having BluePrint to have BlueprintKAPIL SINGAL93-616/+616
Replacing BluePrint with Blueprint throughout Issue-ID: CCSDK-3098 Signed-off-by: KAPIL SINGAL <ks220y@att.com> Change-Id: Ibee8bad07ae7d9287073db2d4f2f2cd730fa8b96
2020-12-16Fixed NoClassDefFoundError when USE_SCRIPT_COMPILE_CACHE is set to falseJulien Fontaine6-4/+178
USE_SCRIPT_COMPILE_CACHE set to false cleans the Class Loader cache after each kotlin script execution. When several kotlin script are executed in parallel (ie no dependency between them) and USE_SCRIPT_COMPILE_CACHE=false then the class loader from the cache may be deleted before one of those executed kotlin script get the time to finish which to the NoClassDefFoundError. Removed cleanupInstance method for kotlin script executors that where causing the class loader to be removed prematurely. Now the behaviour is to remove the class loader from the cache only when we publish a new CBA which was already the case when CDS run with a single instance. In cluster mode, a topic has been added to hazelcast to allow the instance publishing the updated CBA to communicate to the other instances by sending a message to clean the class loader for this CBA from their cache. Added mutex on kotlin script compilation to fix race condition. For concurrent kotlin script execution each process wanted to compile an executable but it was causing a race condition if a process tries to execute while another still compile. Mutex on the execution path prevent this behaviour Issue-ID: CCSDK-3052 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I6ab002352b3272898ad0b183341ee664652c8ae3
2020-12-14Updating parent pom version to 2.1.1-SNAPSHOTSingal, Kapil (ks220y)1-1/+1
Comenting out testSampleAaiReq from RestClientServiceTest.kt as this is causing verify job timeout Issue-ID: CCSDK-3046 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I38d88814335b83167597c1a24162ad3c743355f3
2020-12-08CDS add Swagger annotations for BP Model APIJakobKrieg1-0/+20
Issue-ID: CCSDK-3014 Change-Id: Ibca7cbaa2c70f04acf818e2b554664e13b116c5e Signed-off-by: JakobKrieg <jakob.krieg@bcmsolutions.de>
2020-11-12Remove URI encoding in BlueprintWebClientServiceJozsef Csongvai2-22/+6
Malformed uri's should be handled by resource resolution in the cba Issue-ID: CCSDK-2980 Change-Id: I5c1cf97519a882ff5cf99e9850c65df9ba6d9c36 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2020-10-21Update AAI endpoints to /aai/v22 for HonoluluLasse Kaihlavirta1-11/+11
- Update all /aai/v21 references to /aai/v22 for Honolulu - note that the previous https://gerrit.onap.org/r/c/ccsdk/cds/+/114057 was for Guilin only Issue-ID: CCSDK-2914 Signed-off-by: Lasse Kaihlavirta <l.kaihlavirt@partner.samsung.com> Change-Id: I8103b12610a9de7263789a0852140f2f0bb09393
2020-10-20Update AAI endpoints to /aai/v21Lasse Kaihlavirta1-11/+11
- Update all /aai/v14 references to /aai/v21 to resolve certificate problems in CDS when trying to resolve attribute values with aai-data source Issue-ID: CCSDK-2914 Signed-off-by: Lasse Kaihlavirta <l.kaihlavirt@partner.samsung.com> Change-Id: I6b150348b66e93b3d08ceaa49fa997d531ddb0e4
2020-09-22Roll to initial Honolulu versionDan Timoney9-9/+9
Roll to initial Honolulu version Issue-ID: CCSDK-2742 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I563033c6c93a4121219eaa1d7bb8a026e9e490d4
2020-09-22Enabling Code FormatterSingal, Kapil (ks220y)66-688/+872
Code Formatter was turned off due to java 11 migation Issue-ID: CCSDK-2852 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I3d02ed3cc7a93d7551fe25356512cfe8db1517d8
2020-09-11Refactoring poms groupId artifactIdSingal, Kapil (ks220y)9-56/+53
Issue-ID: CCSDK-2787 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: Ica64f0c793beabb47950c7bf1eede63a0dbf3cea
2020-08-27KafkaMessageConsumerService: 'launch' was missingOleg Mitsura1-9/+12
Issue-ID: CCSDK-2704 This was accidentally removed few commits back. Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: I8f08c72e8d5695c1262aad2d10d1081bbabbdfcb