aboutsummaryrefslogtreecommitdiffstats
path: root/ms/blueprintsprocessor
AgeCommit message (Collapse)AuthorFilesLines
2021-07-27Removed redundant timeout handling for executeCommandJulien Fontaine1-19/+3
executeCommand was called from a GlobalScope.async coroutine to handle executeCommand timeout. Execution timeout is already handled on the gRPC side, there's no need to handle this timeout by wrapping the gRPC call with a coroutine timeout. When a lot of long running processes in executeCommand were running, it was causing process to queue on BP side to get their executeCommand executed because all the capacity of couroutines were being used by some long running process. This was causing a delay on the execution of prepareEnv and executeCommand and would even some time make those process timeout because of component timeout. Issue-ID: CCSDK-3386 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: If3aef4b6b65006e874525436bf3f6d1b1a3d8c9a
2021-06-23Add Request ID and Sub Request ID to CDS kafka logsJulien Fontaine3-22/+23
Improved log message when a message is published or consumed by CDS Kafka to specify the RequestID and SubRequestID. Issue-ID: CCSDK-3348 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I50e068d9aa36df8fe4ee5f0f6a8e9bd7a1209467
2021-05-13Add MS SQL driver in CDS blueprints andPrudence Au6-5/+81
DB resolution fails on an empty dataset with required template mapping. Issue-ID: CCSDK-3293 Issue-ID: CCSDK-3294 Signed-off-by: Prudence Au <prudence.au@amdocs.com> Change-Id: I9f302d12e7359b62180fcdfddbd8ae2c993a8324
2021-04-28Merge "Fixed error when uploading CBA when Hazelcast cluster is not initialized"Dan Timoney1-4/+2
2021-04-28Fixed error when uploading CBA when Hazelcast cluster is not initializedJulien Fontaine1-4/+2
Hazelcast is used to enable CDS pods to notify the rest of the CDS cluster when a CBA got updated locally so they clean their compile cache (if they have an entry for that CBA). Though, the code doesn't make sure that hazelcast cluster is fully initialized before trying to notify using a hazelcast topic. Fixed that error by making sure that the cluster is fully initialized before pushing notification to hazelcast topic. Issue-ID: CCSDK-3277 Change-Id: I44211c63c5a991269005bcc238f18b19979cb718 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2021-04-28Add check for cluster status to readiness endpointJozsef Csongvai1-3/+14
When Cluster is enabled, BlueprintsProcessor should not process any requests until cluster is fully joined. Issue-ID: CCSDK-3275 Change-Id: I779159346976f7af0c0add69883f27d7f359f413 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-04-26Fix for CCSDK-3271 added kotlin compiler option java 11vmuthukrishnan@aarnanetworks.com1-0/+2
Issue-ID: CCSDK-3271 Change-Id: I9c007c9e332206fb1631442d6acfd41a1e57a882 Signed-off-by: vmuthukrishnan@aarnanetworks.com <vmuthukrishnan@aarnanetworks.com>
2021-04-22Fix grpcProperties resolution for String valuesJozsef Csongvai1-2/+3
When a CBA defines a String selector, it will be passed as TextNode. This enables using using application properties to define grpcClientProperties for py executor. Issue-ID: CCSDK-3272 Change-Id: Id4fcd4f43306e385458eb4decbb07f923a957cc0 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-04-09Fixed templating of values in k8s componentsLukasz Rajewski3-3/+3
Fixed templating of values in k8s components Issue-ID: CCSDK-3265 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@orange.com> Change-Id: If6a10c9ae0157a873433f7c3e7c12d90eb5c2cf6
2021-04-07Remove trust all for BasicAuthRestClientServiceClaudio D. Gasparini1-18/+0
following global requirement expected in Istanbul, which forbids disabling host name verification Issue-ID: CCSDK-3245 Signed-off-by: Claudio D. Gasparini <claudio.gasparini@intl.att.com> Change-Id: I89c37a94cb3999a8f1813d3fc33958421b183de1
2021-04-05Merge "Fixing DockerFile to avoid IOException"KAPIL SINGAL2-8/+20
2021-03-30Extend Restconf executor functionClaudio D. Gasparini4-71/+363
provide capability to - execute a sorted array of restconf actions - mount odl restconf node Issue-ID: CCSDK-3241 Signed-off-by: Claudio D. Gasparini <claudio.gasparini@intl.att.com> Change-Id: I1999195f7b84a259d82f9c5aa31e9fa892e9c3df
2021-03-29Fixing DockerFile to avoid IOExceptionSingal, Kapil (ks220y)2-8/+20
chown on /opt isn't enough as files/directory permissions needs change so that onap user can access to execute Even if chown onap:onap was done, it was failing to create/run script due to permission issues Adding noCache to docker-maven-plugin so that it won't pick cached layers Issue-ID: CCSDK-3224 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: Idf56465eff6fa42b523bccfca56f84e93496a8d2
2021-03-27Merge "Address some pendings items for SSLBasicAuthRestClient"KAPIL SINGAL5-27/+50
2021-03-25Address some pendings items for SSLBasicAuthRestClientClaudio D. Gasparini5-27/+50
- FIXME under SSLBasicAuthRestClientProperties - TODO under SSLBasicAuthRestClientPropertiesBuilder Issue-ID: CCSDK-3235 Signed-off-by: Claudio D. Gasparini <claudio.gasparini@intl.att.com> Change-Id: If00c7491573c69eb5d3f9192f54c7b384943abf7
2021-03-25Fixed K8s HealthCheck API issueLukasz Rajewski2-21/+94
Fixed K8s HealthCheck API issue Issue-ID: CCSDK-3230 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@orange.com> Change-Id: Ic341cc7ef36d5fe86cf2b74813bb1f8fc0842f6f
2021-03-24Fixed bug when k8s profile is created for default k8s versionLukasz Rajewski2-1/+9
Fixed bug when k8s profile is created for default k8s version Issue-ID: CCSDK-3239 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@orange.com> Change-Id: Ibc0c8a6057b4b9eef3beb1821093b935f3b2e53b
2021-03-23Fix Certificate Exception when using BasicAuthRestClientServiceClaudio D. Gasparini1-0/+18
by using TrustAllStrategy Issue-ID: CCSDK-3234 Signed-off-by: Claudio D. Gasparini <claudio.gasparini@intl.att.com> Change-Id: I7ee63739b4f1d7a4ddbc618ba660704aa058752a
2021-03-22Bug fixes for config template and config value componentsLukasz Rajewski8-59/+200
Issue-ID: CCSDK-3232 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@orange.com> Change-Id: I817d83001a76ba480472c7aa2da15eba65b39c20
2021-03-19Prohibit cycles in imperative workflowsJozsef Csongvai4-13/+107
Issue-ID: CCSDK-3221 Change-Id: I767003dde40c0fc53a673c4a41cb2430624d7b04 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-03-19Merge "Print process name with UAT assert error message"KAPIL SINGAL1-8/+8
2021-03-19Merge "Refactoring to enable on_failure for imperative workflow"KAPIL SINGAL44-94/+124
2021-03-18ComponentRemotePythonExecutor prepareEnv bugOleg Mitsura1-37/+11
Issue-ID: CCSDK-3086 commit 1: orig commit commit 2: update retry counter commit 3: bug fix for packages being null should still trigger creation of python environment Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: Id9e7024df8c604c719828211cce31d6f0452330b
2021-03-17Print process name with UAT assert error messageJozsef Csongvai1-8/+8
Issue-ID: CCSDK-3220 Change-Id: I6ea56454f777017d78bed0bd1755611dac5d5255 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-03-17Refactoring to enable on_failure for imperative workflowJozsef Csongvai44-94/+124
BlueprintError needs to associate errors with the steps in which they occurred in order for imperative workflow to handle on_failure properly. Made stepName more accessible and corrected places where stepName was assigned to nodeTemplateName. Issue-ID: CCSDK-3219 Change-Id: I7e5805745c63558cff6be533e1b99c32ad06c3db Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2021-03-16Assign a unique worker ID for CDS Kafka workerJulien Fontaine7-37/+113
* Modified CDS Kafka workers to add the 5 lasts characters of the env var HOSTNAME to their worker ID. * Small refactoring to move some utilitary functions to BlueprintMessageUtils Issue-ID: CCSDK-3204 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Iaacd35e9cbe4705d17548518040c679185eaf30a
2021-03-09Add delete endpoint for config snapshot APIJulien Fontaine4-1/+124
Add delete endpoint to delete config-snapshots based on resource-type, resource-id and resources-status. Issue-ID: CCSDK-3205 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Id7954694bc93beba08a79139834cb6477cb8e44b
2021-03-09Roll master version for IstanbulDan Timoney40-40/+40
Roll versions of ccskd parent poms to 2.2.0-SNAPSHOT and of ccsdk/cds to 1.2.0-SNAPSHOT for Istanbul release Issue-ID: CCSDK-3190 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: Iab0bf047c8d2e4ddaaadf2e6278917ed2de338e5
2021-03-04Release version 1.1.1 of CDS dockersDan Timoney40-40/+40
Release new CDS dockers to correct issues found with release 1.1.0 dockers. Issue-ID: CCSDK-3192 Issue-ID: CCSDK-3197 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I3bc1acbb93f0bb95ef14a6565e66d8da7a5df21d
2021-02-24Add rollback and update functionality for config-value component.Grzegorz Wielgosinski2-42/+79
Issue-ID: CCSDK-2922 Signed-off-by: Grzegorz Wielgosinski <g.wielgosins@samsung.com> Change-Id: I7384aa3d99fe273454e3acf2f933add0fb07a66c
2021-02-23Release version 1.1.0 docker containers and roll to next versionDan Timoney40-40/+40
Release version 1.1.0 docker containers and roll to next version Issue-ID: CCSDK-3179 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: I2518ba1dd5a4bd926499867f5f9714bc3f716732
2021-02-20Merge "Wrap day2 api and create configuration-value component"KAPIL SINGAL6-17/+397
2021-02-19K8sPlugin Query API endpoint addedLukasz Rajewski1-0/+29
K8sPlugin Query API endpoint added Issue-ID: CCSDK-3146 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@orange.com> Change-Id: I10abfd986de0df0069b258276fe0ec0fc9b76bff
2021-02-19Wrap day2 api and create configuration-value componentGrzegorz Wielgosinski6-17/+397
Issue-ID: CCSDK-2922 Signed-off-by: Grzegorz Wielgosinski <g.wielgosins@samsung.com> Change-Id: Idef821362af9351c8ae48accc616f744f0b462d6
2021-02-17K8sPlugin Healthcheck API and API refactoringLukasz Rajewski5-29/+171
K8sPlugin Healthcheck API and API refactoring Issue-ID: CCSDK-3146 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@orange.com> Change-Id: Ic3040c888bf78b6d3c91f282200e6f32a3f69816
2021-02-17Fixed null pointer exception for JSON RALukasz Rajewski1-1/+3
Fixed null pointer exception for JSON RA Issue-ID: CCSDK-3170 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@orange.com> Change-Id: I721ff7966a1c1bd99ab948cdc410f05688ddea23
2021-02-151. Wrap configuration-template DAY2 APIGrzegorz Wielgosinski3-0/+376
2. Create config-template component Issue-ID: CCSDK-2922 Signed-off-by: Grzegorz Wielgosinski <g.wielgosins@samsung.com> Change-Id: I124c5995294c2c05eab471eb3a2658368a49cf06
2021-02-11Added Kafka metrics for CDS workersJulien Fontaine17-44/+243
Added counters to gather metrics on CDS Kafka workers. This will enable us to get metrics on how many messages we consumer and produce to/from kafka. For consumers we count how many messages we consume and how many failed ie. consumed but not able to be processed (parsing error). For producers we count how many messages we produce and how many failed ie. failed to be pushed to the cluster (unavailable brokers, network error, ...). Relocated metrics tag constants to BlueprintConstants so that they can be use by any CDS module. If they make sense for other metrics then they should be shared. Issue-ID: CCSDK-3155 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Iad6aba588766f655f3a74cd626e0f74e29188f96
2021-02-11Improve logging for CDS Kafka workersJulien Fontaine4-28/+47
Modified CDS Kafka consumersand producers logs to provide more details about the topic of the consumer record being consumed or published. Refactored the publish callback to make it more readable. Refactored audit service log error messages. Issue-ID: CCSDK-3154 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I7b42930e926bc15ce175974a78d3bfe2f219b0a8
2021-02-10K8sPlugin Instance API HandlersLukasz Rajewski12-41/+487
Issue-ID: CCSDK-3146 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@orange.com> Change-Id: I404957d5e782b8943bbe0d8bc501bbe88d524483
2021-02-09Instance dependencies in ComponentScriptExecutorLukasz Rajewski1-1/+7
Issue-ID: CCSDK-3146 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@orange.com> Change-Id: I6502abd0d2a3fa85cefc3bc6a900f27171b51569
2021-02-09Move configuration beans out of profile.upload packageGrzegorz Wielgosinski7-100/+170
Issue-ID: CCSDK-3130 Signed-off-by: Grzegorz Wielgosinski <g.wielgosins@samsung.com> Change-Id: Id7a69e7c0a84c0b5556b5ae2a02835de647345c2
2021-02-03Issue-ID: CCSDK-3130Grzegorz Wielgosinski10-6/+8
1. Change module name to k8s-connection-plugin 2. Move K8sPluginApi.kt and K8sUploadFileRestClientService.kt out of profile.upload package Signed-off-by: Grzegorz Wielgosinski <g.wielgosins@samsung.com> Change-Id: I1708428ce986bc97e69dfbef9cf837a8039ccfe8
2021-01-26PV/PVC eliminationOleg Mitsura6-20/+195
Issue-ID: CCSDK-3086 1. initial commit 2. fix accidental paste / rebased cleaned up unneeded validation call in cmd-exec upload Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: Ife5460c5be59aa8d8592d82099b27c507b08c6c6
2021-01-22Renaming Files having BluePrint to have BlueprintKAPIL SINGAL380-3975/+3975
Replacing BluePrint with Blueprint throughout Issue-ID: CCSDK-3098 Signed-off-by: KAPIL SINGAL <ks220y@att.com> Change-Id: Ibee8bad07ae7d9287073db2d4f2f2cd730fa8b96
2021-01-08CDS add Swagger annotations for Model Type APIPiotr Stanior2-1/+35
Issue-ID: CCSDK-3014 Change-Id: I469151beef8ebf63b3a24ca4ce9a047c0b80850a Signed-off-by: Piotr Stanior <piotr.stanior@t-mobile.pl>
2020-12-17Merge "Fixed NoClassDefFoundError when USE_SCRIPT_COMPILE_CACHE is set to false"KAPIL SINGAL17-48/+192
2020-12-16Refactoring assembly.id and name.spaceSingal, Kapil (ks220y)2-3/+1
Upgrading base onap/ccsdk-alpine-j11-image to version 1.1.0 Issue-ID: CCSDK-3053 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I135893a4ab1d4d3f7c1297d6e66de133bd3c7150
2020-12-16Fixed NoClassDefFoundError when USE_SCRIPT_COMPILE_CACHE is set to falseJulien Fontaine17-48/+192
USE_SCRIPT_COMPILE_CACHE set to false cleans the Class Loader cache after each kotlin script execution. When several kotlin script are executed in parallel (ie no dependency between them) and USE_SCRIPT_COMPILE_CACHE=false then the class loader from the cache may be deleted before one of those executed kotlin script get the time to finish which to the NoClassDefFoundError. Removed cleanupInstance method for kotlin script executors that where causing the class loader to be removed prematurely. Now the behaviour is to remove the class loader from the cache only when we publish a new CBA which was already the case when CDS run with a single instance. In cluster mode, a topic has been added to hazelcast to allow the instance publishing the updated CBA to communicate to the other instances by sending a message to clean the class loader for this CBA from their cache. Added mutex on kotlin script compilation to fix race condition. For concurrent kotlin script execution each process wanted to compile an executable but it was causing a race condition if a process tries to execute while another still compile. Mutex on the execution path prevent this behaviour Issue-ID: CCSDK-3052 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I6ab002352b3272898ad0b183341ee664652c8ae3
2020-12-16Fixing typo in message-prioritizationSingal, Kapil (ks220y)36-9/+9
Refactoring few POMs name tag Issue-ID: CCSDK-3053 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I14447ea7f93efcc970213bbe7d42663cb87e33d7