aboutsummaryrefslogtreecommitdiffstats
path: root/ms
AgeCommit message (Collapse)AuthorFilesLines
2021-02-11Added Kafka metrics for CDS workersJulien Fontaine17-44/+243
Added counters to gather metrics on CDS Kafka workers. This will enable us to get metrics on how many messages we consumer and produce to/from kafka. For consumers we count how many messages we consume and how many failed ie. consumed but not able to be processed (parsing error). For producers we count how many messages we produce and how many failed ie. failed to be pushed to the cluster (unavailable brokers, network error, ...). Relocated metrics tag constants to BlueprintConstants so that they can be use by any CDS module. If they make sense for other metrics then they should be shared. Issue-ID: CCSDK-3155 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Iad6aba588766f655f3a74cd626e0f74e29188f96
2021-02-11Improve logging for CDS Kafka workersJulien Fontaine4-28/+47
Modified CDS Kafka consumersand producers logs to provide more details about the topic of the consumer record being consumed or published. Refactored the publish callback to make it more readable. Refactored audit service log error messages. Issue-ID: CCSDK-3154 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: I7b42930e926bc15ce175974a78d3bfe2f219b0a8
2021-02-10K8sPlugin Instance API HandlersLukasz Rajewski12-41/+487
Issue-ID: CCSDK-3146 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@orange.com> Change-Id: I404957d5e782b8943bbe0d8bc501bbe88d524483
2021-02-09Instance dependencies in ComponentScriptExecutorLukasz Rajewski1-1/+7
Issue-ID: CCSDK-3146 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@orange.com> Change-Id: I6502abd0d2a3fa85cefc3bc6a900f27171b51569
2021-02-09Move configuration beans out of profile.upload packageGrzegorz Wielgosinski7-100/+170
Issue-ID: CCSDK-3130 Signed-off-by: Grzegorz Wielgosinski <g.wielgosins@samsung.com> Change-Id: Id7a69e7c0a84c0b5556b5ae2a02835de647345c2
2021-02-03Issue-ID: CCSDK-3130Grzegorz Wielgosinski10-6/+8
1. Change module name to k8s-connection-plugin 2. Move K8sPluginApi.kt and K8sUploadFileRestClientService.kt out of profile.upload package Signed-off-by: Grzegorz Wielgosinski <g.wielgosins@samsung.com> Change-Id: I1708428ce986bc97e69dfbef9cf837a8039ccfe8
2021-01-26PV/PVC eliminationOleg Mitsura11-110/+596
Issue-ID: CCSDK-3086 1. initial commit 2. fix accidental paste / rebased cleaned up unneeded validation call in cmd-exec upload Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: Ife5460c5be59aa8d8592d82099b27c507b08c6c6
2021-01-22Renaming Files having BluePrint to have BlueprintKAPIL SINGAL398-4135/+4135
Replacing BluePrint with Blueprint throughout Issue-ID: CCSDK-3098 Signed-off-by: KAPIL SINGAL <ks220y@att.com> Change-Id: Ibee8bad07ae7d9287073db2d4f2f2cd730fa8b96
2021-01-08CDS add Swagger annotations for Model Type APIPiotr Stanior2-1/+35
Issue-ID: CCSDK-3014 Change-Id: I469151beef8ebf63b3a24ca4ce9a047c0b80850a Signed-off-by: Piotr Stanior <piotr.stanior@t-mobile.pl>
2020-12-30[docker] use `--no-cache-dir` flag to `pip` in dockerfiles to save spacePratik raj2-4/+3
using "--no-cache-dir" flag in pip install ,make sure downloaded packages by pip don't cached on system . This is a best practice which make sure to fetch from repo instead of using local cached one . Further , in case of Docker Containers , by restricting caching , we can reduce image size. In term of stats , it depends upon the number of python packages multiplied by their respective size . e.g for heavy packages with a lot of dependencies it reduce a lot by don't caching pip packages. Further , more detail information can be found at https://medium.com/sciforce/strategies-of-docker-images-optimization-2ca9cc5719b6 Issue-ID: CCSDK-3071 Signed-off-by: Pratik Raj <rajpratik71@gmail.com> Change-Id: I9c957bda7fbcf631ce9be65bd5bcc41d2c9ada48
2020-12-17Merge "Fixed NoClassDefFoundError when USE_SCRIPT_COMPILE_CACHE is set to false"KAPIL SINGAL17-48/+192
2020-12-16Refactoring assembly.id and name.spaceSingal, Kapil (ks220y)6-10/+2
Upgrading base onap/ccsdk-alpine-j11-image to version 1.1.0 Issue-ID: CCSDK-3053 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I135893a4ab1d4d3f7c1297d6e66de133bd3c7150
2020-12-16Fixed NoClassDefFoundError when USE_SCRIPT_COMPILE_CACHE is set to falseJulien Fontaine17-48/+192
USE_SCRIPT_COMPILE_CACHE set to false cleans the Class Loader cache after each kotlin script execution. When several kotlin script are executed in parallel (ie no dependency between them) and USE_SCRIPT_COMPILE_CACHE=false then the class loader from the cache may be deleted before one of those executed kotlin script get the time to finish which to the NoClassDefFoundError. Removed cleanupInstance method for kotlin script executors that where causing the class loader to be removed prematurely. Now the behaviour is to remove the class loader from the cache only when we publish a new CBA which was already the case when CDS run with a single instance. In cluster mode, a topic has been added to hazelcast to allow the instance publishing the updated CBA to communicate to the other instances by sending a message to clean the class loader for this CBA from their cache. Added mutex on kotlin script compilation to fix race condition. For concurrent kotlin script execution each process wanted to compile an executable but it was causing a race condition if a process tries to execute while another still compile. Mutex on the execution path prevent this behaviour Issue-ID: CCSDK-3052 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca> Change-Id: I6ab002352b3272898ad0b183341ee664652c8ae3
2020-12-16Fixing typo in message-prioritizationSingal, Kapil (ks220y)37-10/+10
Refactoring few POMs name tag Issue-ID: CCSDK-3053 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I14447ea7f93efcc970213bbe7d42663cb87e33d7
2020-12-15CDS add Postman collection for Resource, Template, Dictionary and Config APIPiotr Stanior6-79/+78
Issue-ID: CCSDK-3014 Change-Id: Ic9892c035067064fd612f2781507a36072e4e712 Signed-off-by: Piotr Stanior <piotr.stanior@t-mobile.pl>
2020-12-14Merge "CDS API reference add request classes"KAPIL SINGAL1-8/+21
2020-12-14Merge "Pass on MDCContext to imperative workflow"KAPIL SINGAL2-4/+14
2020-12-14Merge "CDS add Swagger annotations for Resource, Template, Dictionary and ↵KAPIL SINGAL8-37/+110
Config API"
2020-12-14Merge "ResourceResolution should fail if required resource did not resolve ↵KAPIL SINGAL1-2/+5
-edge case"
2020-12-14CDS Swagger remove yaml filesJakobKrieg1-1/+1
Issue-ID: CCSDK-3014 Change-Id: I3f2f6bbe4d7f2b49e0ff1511f2938d258cc4976b Signed-off-by: JakobKrieg <jakob.krieg@bcmsolutions.de>
2020-12-14CDS API reference add request classesJakobKrieg1-8/+21
Issue-ID: CCSDK-3014 Change-Id: If0a0a6169ac43a66c3dc51639e3a22efa49dcba5 Signed-off-by: JakobKrieg <jakob.krieg@bcmsolutions.de>
2020-12-14CDS add Swagger annotations for Resource, Template, Dictionary and Config APIPiotr Stanior8-37/+110
Issue-ID: CCSDK-3014 Change-Id: I380c38cde52a748a9b797c573b7651a766e8b496 Signed-off-by: Piotr Stanior <piotr.stanior@t-mobile.pl>
2020-12-14Pass on MDCContext to imperative workflowJozsef Csongvai2-4/+14
Issue-ID: CCSDK-3032 Change-Id: Id62ab38064d5d3b1a24db674804d710ca407940e Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2020-12-14ResourceResolution should fail if required resource did not resolve -edge casekuldipr1-2/+5
Issue-ID: CCSDK-3022 Signed-off-by: kuldipr <kuldip.rai@amdocs.com> Change-Id: Ia88a86f13c693a7bcd2d61cdfb5c2e39041b5a31 Signed-off-by: kuldipr <kuldip.rai@amdocs.com>
2020-12-14Updating parent pom version to 2.1.1-SNAPSHOTSingal, Kapil (ks220y)1-1/+1
Comenting out testSampleAaiReq from RestClientServiceTest.kt as this is causing verify job timeout Issue-ID: CCSDK-3046 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I38d88814335b83167597c1a24162ad3c743355f3
2020-12-08CDS add Swagger annotations for BP Model APIJakobKrieg4-36/+219
Issue-ID: CCSDK-3014 Change-Id: Ibca7cbaa2c70f04acf818e2b554664e13b116c5e Signed-off-by: JakobKrieg <jakob.krieg@bcmsolutions.de>
2020-12-04Merge "ResourceResolution should fail if required resource did not resolve"KAPIL SINGAL3-16/+35
2020-12-04ResourceResolution should fail if required resource did not resolvekuldipr3-16/+35
Issue-ID: CCSDK-3022 Signed-off-by: kuldipr <kuldip.rai@amdocs.com> Change-Id: I6ca858988f0b11bdf3bbde07e8f4bde939342aa2 Signed-off-by: kuldipr <kuldip.rai@amdocs.com>
2020-12-03add toggle variable ansible fire failure to awx functionEltanany Shaaban1-2/+2
-add logs output when it fails Issue-ID: CCSDK-2366 Signed-off-by: Eltanany Shaaban <shaaban.eltanany.ext@orange.com> Change-Id: Ie1a122865be541a45de157ab3afa9e426d1defb4
2020-12-03Merge "add toggle variable ansible fire failure to awx function"KAPIL SINGAL1-3/+16
2020-12-03add toggle variable ansible fire failure to awx functionEltanany Shaaban1-3/+16
Issue-ID: CCSDK-2366 Signed-off-by: Eltanany Shaaban <shaaban.eltanany.ext@orange.com> Change-Id: I42b757c206c6d420ffa289cbe9e6c2b4dbf22b20
2020-12-02CDS Fix Swagger issuesPiotr Stanior4-3/+4
Fixed unique id generation for overloaded method. Changed example values in ApiModelProperty annotation to fix issues in Swagger json file. Issue-ID: CCSDK-3014 Change-Id: If83dc88187b62346182d1fb4b753aae544bbc322 Signed-off-by: Piotr Stanior <piotr.stanior@t-mobile.pl>
2020-12-02CDS change Swagger file output directory to docsJakobKrieg1-1/+1
Issue-ID: CCSDK-3014 Change-Id: Ib0c6a0ffbf5357b64407138b8c0488f05e259d41 Signed-off-by: JakobKrieg <jakob.krieg@bcmsolutions.de>
2020-12-01CDS add swagger maven pluginJakobKrieg1-0/+60
Issue-ID: CCSDK-3011 Change-Id: If83fc5668dc5dad7ec0b5499141024303a3ca372 Signed-off-by: JakobKrieg <jakob.krieg@bcmsolutions.de>
2020-11-27CDS migrate to springfox 3.0.0JakobKrieg2-45/+3
Old dependencies and Annotations removed. Refer official documentation: https://springfox.github.io/springfox/docs/snapshot/#migrating-from-existing-2-x-version Issue-ID: CCSDK-3004 Change-Id: I3f4ce138dc83d74ea1b1e64b0ff4cf5badd3873b Signed-off-by: JakobKrieg <jakob.krieg@bcmsolutions.de>
2020-11-23Support for generic URL for mount, Put, Get addedtragait1-0/+70
Issue-ID: CCSDK-2993 Signed-off-by: tragait <rahul.tyagi@est.tech> Change-Id: I4061d6ba5084806c0a14b137e169f73cdd68a588
2020-11-20Refactoring POM and removing duplicate dependencySingal, Kapil (ks220y)1-19/+4
Issue-ID: CCSDK-2998 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I68e5c0c89c8f7100c3f3725e1682676688c319ab
2020-11-12Merge "Remove URI encoding in BlueprintWebClientService"KAPIL SINGAL2-22/+6
2020-11-12Remove URI encoding in BlueprintWebClientServiceJozsef Csongvai2-22/+6
Malformed uri's should be handled by resource resolution in the cba Issue-ID: CCSDK-2980 Change-Id: I5c1cf97519a882ff5cf99e9850c65df9ba6d9c36 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2020-10-28Merge "Blueprints Processor Metrics"KAPIL SINGAL10-4/+147
2020-10-28Enable retrieving ResourceResolution objects from database in kotlin scriptskuldip Rai1-0/+19
Issue-ID: CCSDK-2949 Change-Id: I9605d8cdb2a61cba45c56f3dcc12740d4da0b5c8 Signed-off-by: kuldipr <kuldip.rai@amdocs.com>
2020-10-28Blueprints Processor MetricsJulien Fontaine10-4/+147
Add counter and timer for Blueprints Processor process to get success/failure and execution time for each blueprint execution using blueprint name, version and action. Issue-ID: CCSDK-2950 Change-Id: I38e8997de26effe69ec2ee9e2b6ed0da14de4a43 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2020-10-21Fix keytool invocationDan Timoney1-1/+1
Fixed 2 issues with keytool invocation in blueprints-processor start script: 1) removed duplicate '-import' 2) corrected path to cacerts file Issue-ID: CCSDK-2914 Signed-off-by: Dan Timoney <dtimoney@att.com> Change-Id: Id454ebca87811bb9c229ca3145148a7c7a93950b
2020-10-21Update AAI endpoints to /aai/v22 for HonoluluLasse Kaihlavirta2-12/+12
- Update all /aai/v21 references to /aai/v22 for Honolulu - note that the previous https://gerrit.onap.org/r/c/ccsdk/cds/+/114057 was for Guilin only Issue-ID: CCSDK-2914 Signed-off-by: Lasse Kaihlavirta <l.kaihlavirt@partner.samsung.com> Change-Id: I8103b12610a9de7263789a0852140f2f0bb09393
2020-10-20Update AAI endpoints to /aai/v21Lasse Kaihlavirta2-12/+12
- Update all /aai/v14 references to /aai/v21 to resolve certificate problems in CDS when trying to resolve attribute values with aai-data source Issue-ID: CCSDK-2914 Signed-off-by: Lasse Kaihlavirta <l.kaihlavirt@partner.samsung.com> Change-Id: I6b150348b66e93b3d08ceaa49fa997d531ddb0e4
2020-10-13Merge "master: missing input shouldn't fail process"KAPIL SINGAL2-16/+21
2020-10-13adding execution for generation docker imagesShaabanEltanany4-4/+0
Issue-ID: CCSDK-2877 Signed-off-by: ShaabanEltanany <shaaban.eltanany.ext@orange.com> Change-Id: I281e5781730ef77e63c27bf465b92648d814c83c
2020-10-13master: missing input shouldn't fail processOleg Mitsura2-16/+21
Issue-ID: CCSDK-2876 Signed-off-by: Oleg Mitsura <oleg.mitsura@amdocs.com> Change-Id: I76279fee8adc91a3aed72c624c24e93c9cf9dea4
2020-10-09Fixed k8s profile upload for source with tar.gz fileLukasz Rajewski1-12/+9
Fixed k8s profile upload for source with tar.gz file Change was tested with CBA https://gerrit.onap.org/r/c/demo/+/113732 Change-Id: I08aa834cc4fedaf77b4c660ec16dea930dade588 Issue-ID: CCSDK-2899 Signed-off-by: Lukasz Rajewski <lukasz.rajewski@orange.com>
2020-10-06Fix resolution of keyIdentifiersJozsef Csongvai2-4/+4
Issue-ID: CCSDK-2875 Change-Id: Ie089ee7f186f74691556f65a52fbaa7c6c165061 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>