aboutsummaryrefslogtreecommitdiffstats
path: root/ms/blueprintsprocessor/application/src
AgeCommit message (Collapse)AuthorFilesLines
2020-05-06Merge "Truncate message published on Kafka / Spike: Define solution for logs ↵Dan Timoney1-4/+12
separation"
2020-05-05Truncate message published on Kafka / Spike: Define solution for logs separationJulien Fontaine1-4/+12
Refactoring of cmd-exec component - Improve display of error messages within the response - Fix gRPC buffer limitation (4Mb) by truncating error messages and cmd-exec logs if too heavy (>3Mb) Truncation of BP responses (<4Kb) before sending them in kafka audit topics. - Truncation if needed of error messages for every response - Truncation of cmd-exec logs in cmd-exec responses (Spike) Add a flag in the application.properties to enable/disable the display of cmd-exec responses on the BP side (Fix) Correction of BP processing with kafka regression (Fix) Changed default SSL Endpoint Algo Issue-ID: CCSDK-2326 Change-Id: If4d0e661117d1dd156cf19c95774824e754d870a Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2020-04-28Merge "Making POD run as non-root"Dan Timoney1-1/+3
2020-04-24Merge "Secure Kafka Authentication"Dan Timoney2-14/+41
2020-04-23Making POD run as non-rootjananib1-1/+3
Non-root user addition Change-Id: Id110aebea3d3526aaf319d8994670644a7bab698 Issue-ID: CCSDK-2149 Signed-off-by: jananib <janani.b@huawei.com>
2020-04-21Secure Kafka AuthenticationJulien Fontaine2-14/+41
Implementation of kafka secure authentication : - SSL - SASL(SCRAM) & SSL Issue-ID: CCSDK-2313 Change-Id: I4b2fc7abab7478e360ebf461608a620d75708f54 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca>
2020-04-15Making POD run as non-rootjananib1-0/+5
Non-root user addition Change-Id: I82995b0c0a6eb815e0422c6072c111c889c8c84a Issue-ID: CCSDK-2149 Signed-off-by: jananib <janani.b@huawei.com>
2020-04-08Publish execution input/output into Kafka topicsJulien Fontaine2-13/+32
- Creation and implementation of PublishAudit services (NoAudit,Kafka) - Conceal of sensitive data (request input parameters) - Update ExecutionServiceHandler tests - Update application.properties file Issue-ID: CCSDK-2183 Signed-off-by: Julien Fontaine <julien.fontaine@bell.ca> Change-Id: Ifc28a91ce588f5ed0010acb4ed22b64429c6c1a0
2020-03-18Fix GroupId and package name in Error CatalogDan Timoney6-12/+12
Issue-ID: CCSDK-2180 Signed-off-by: Steve Siani <alphonse.steve.siani.djissitchi@ibm.com> Change-Id: Ibe00fc1f2a905821b7100ae4f221ea1e0b934894
2020-03-16Update application properties for ErrorCatalogSteve Siani6-18/+136
Issue-ID: CCSDK-2174 Signed-off-by: Steve Siani <alphonse.steve.siani.djissitchi@ibm.com> Change-Id: I8d8de812bb560ef2c01bc3bee8dd17f9d6ed1099
2020-03-11Enable generation and exposure of git informationebo1-0/+1
Initially only the blueprintprocessor MS will expose these info. Issue-ID: CCSDK-2165 Change-Id: Id0b994e62a2992942ec1def40566a03615c9df3c Signed-off-by: ebo <eliezio.oliveira@est.tech>
2020-03-11Error Catalog Management Core Library.Brinda Santh11-7/+243
Issue-ID: CCSDK-2076 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I9e8e67bdee77fb359a791f4ef4c2963aa78ab93a Signed-off-by: Steve Siani <alphonse.steve.siani.djissitchi@ibm.com>
2020-03-04Restored /spy and /verify UatServices endpointsebo10-0/+0
This is a partial reversal of the breaking change introduced by https://gerrit.onap.org/r/#/c/ccsdk/cds/+/100213/ Issue-ID: CCSDK-2155 Change-Id: Ie1e16b8b7d15bd4605cec37e9185419434d75f70 Signed-off-by: ebo <eliezio.oliveira@est.tech>
2020-02-26Merge SW Upgrade Blueprint into PNF_AAI and create one UAT BP for PNFgummar5-83/+149
UAT: Add support to multiple responses for a single request Set property IN_UAT=1 during UAT execution so blueprints can tune their settings to values more suitable for testing (like timeouts) Add 'times' field to specify expected number of invocations Add UAT blueprint script for PNF SW Upgrade UC Add current thread check for Hazelcast distributed lock Resolve URI before returning Issue-ID: CCSDK-2091 Change-Id: Id256bad043488f88f1b60015ebf9ade4be607fa2 Signed-off-by: gummar <raj.gumma@est.tech>
2020-02-17Removed manual shutdown hook for hazelcastSebastien Premont-Tendland4-13/+12
Shutdown hook for hazelcast are already working with spring boot. Just changed the policy to GRACEFUL (default is TERMINATE). This allow hazelcast to shutdown gracefully and recover from a rolling upgrade Also updated the Dockerfile to use multi stage to reduce by ~200Mb the docker image size. Issue-ID: CCSDK-2011 Signed-off-by: Sebastien Premont-Tendland <sebastien.premont@bell.ca> Change-Id: I0034145c7acefa88ed8d16f23a29249c7225ace3
2020-02-14Cluster CP member promotion as default.Brinda Santh2-1/+4
Issue-ID: CCSDK-2011 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I4df4b442c020fbf9da294a9b35739ca3acb8ee02
2020-02-12Cluster co-ordination with Hazelcast.Brinda Santh8-117/+99
Remove Atomix implementation, due to Kubernetes clustering issues. Cluster environment property changes. Issue-ID: CCSDK-2011 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I23f40c92c0adc6b3ab8690871385f78525c76433
2020-01-31Spring boot, Kotlin version upgradesBrinda Santh1-1/+3
Dependent Patch : https://gerrit.onap.org/r/c/ccsdk/parent/+/100990 Fixed Jackson set method according to latest version. Fixed Security properties issues for failed JUnit test cases. Reused maven properties from parent for Spring boot, Nats, Kafka, etc Issue-ID: CCSDK-1737 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I04bb0e535161e05897f587a0f08a2689e10c5f41
2020-01-17Fix scheduler shutdown config function.Brinda Santh3-10/+9
Optimize application name accessing in Docker Compose. Issue-ID: CCSDK-1917 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I6b055de7ef5a8ac4a0c103499997ed272bd74ac6
2020-01-16Prioritization Optional NATS consumer supportBrinda Santh2-3/+37
Add prioritization NATS consumer service and configuration data beans. Optimizing message prioritization service interface. Added Integration testing for NATS simulation. Updated sample docker compose for NATS support Issue-ID: CCSDK-1917 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: Icd21e5e2ab7b64d6e6e4b0610599ca947555ee15
2020-01-13Prioritization expiry and clean scheduler serviceBrinda Santh1-16/+5
Add prioritization expiry and clean scheduler service implementation. Optimizing message passing between processors. Added message sorting utils. Issue-ID: CCSDK-1917 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I049ea3bae2e2c546244136f15c3d89deda1e7053
2020-01-12Refactoring Pom and Fixing JunitsSingal, Kapil (ks220y)17-21/+52
Refactoring DepeendencyManagement section in parent pom and fixed Junit failing over Windows Issue-ID: CCSDK-2023 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: I5e09c4c6d6307c1dd93a40ab3601713b956dfc72
2020-01-08Merge "Add custom header configuration for aai calls"Brinda Santh Muthuramalingam2-1/+6
2020-01-08Add custom header configuration for aai callsJozsef Csongvai2-1/+6
Issue-ID: CCSDK-2020 Change-Id: Ibd63a00bf59b0e955612da69fa1d4970381b9a64 Signed-off-by: Jozsef Csongvai <jozsef.csongvai@bell.ca>
2020-01-07Include correlationId in group lock.Brinda Santh2-9/+91
Message prioritization optimization by checking and including correlation Id, so that non related correlation message won't get locked. Optimized Atomix Junit Test cases. Issue-ID: CCSDK-2011 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I090ed4c193c7f9af4014cfeee4c6208c12b542c1
2020-01-02Message Prioritization message group lock.Brinda Santh1-0/+7
Implementation to avoid concurrent procession of message group while prioritization. Sample message prioritization Kafka listener properties. Issue-ID: CCSDK-2011 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: Ifbf39985b03c662b6ccf7740be711cfeb7bfbebb
2019-12-24add group notation to resource dictionaryshaaban Altanany1-0/+1
-including changes to (starter-dictionary,test-dictionary)json files -add column in resource dictionary table in database -expose api for getting unique group from resource dictionary table Issue-ID: CCSDK-2004 Signed-off-by: shaaban Altanany <shaaban.eltanany.ext@orange.com> Change-Id: I0998709af2e692717b9b1b4937943c323144594a
2019-12-23Cluster distributed lock service.Brinda Santh3-33/+25
Included and fixed clustered env properties and utils. Fixed docker compose instance sequence numbers. Issue-ID: CCSDK-2011 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: Ie28935ae7cb3de8c77cd7110993304eb49799b6c
2019-12-19Cluster communication channelsBrinda Santh1-0/+15
Add NATS property and library services both . NATS Messaging Services with Token Auth and TLS Auth implementation Docker Compose for NATS Streaming instance. Documentation : https://docs.nats.io/ Issue-ID: CCSDK-2007 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: Ieebaa8f2b18ae89d02a4f38a8027eda495a9db43
2019-12-16Cluster distributed data storeBrinda Santh7-2/+284
Add experimental cluster co-ordination service using Atomic framework. Included distributed data store creation utilities. Sample docker compose data cluster between cds controller and resource-resolution instances. Issue-ID: CCSDK-2000 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I4de00e773a996e08fd1d260fc27ed18832433883
2019-12-09Merge "Add default values for health-api properties"KAPIL SINGAL1-7/+18
2019-12-06Refractor controller blueprint modulesBrinda Santh2-5/+7
Move controller blueprints modules to blueprints processor and change the maven group name. Fix test cba and model type paths Fix dependencies issues. Issue-ID: CCSDK-1663 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I3654e6f04811470327acba90e8a452b66e3e189b
2019-12-04Add default values for health-api propertiesShaabanEltanany1-7/+18
Issue-ID: CCSDK-1669 Signed-off-by: ShaabanEltanany <shaaban.eltanany.ext@orange.com> Change-Id: I28d6c829a8f6d41aee52a21b9391b7f642359756
2019-11-29Upgrade py executor ms GRPC version.Brinda Santh5-9/+57
Regenerate TLS certs with config file. Issue-ID: CCSDK-1737 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I2b0982c4e230524ad1e58f150da2a05e4474a0fa
2019-11-29Optimize spring data JPA UT.Brinda Santh1-0/+59
Test case based database configuration, so that we can define what repositories and entities can be used for testing. Issue-ID: CCSDK-1735 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I4f8a7eb4ed47fec9ab17eb9552648ebd0de01236
2019-11-26Formatting Code base with ktlintSingal, Kapil (ks220y)24-201/+258
No Business logic change, just the code format. Competible with IntelliJ: https://github.com/pinterest/ktlint#option-3 To format run: mvn process-sources -P format Issue-ID: CCSDK-1947 Signed-off-by: Singal, Kapil (ks220y) <ks220y@att.com> Change-Id: Ic9e9209fb7023d77f434693ad5a01229f8d09331
2019-11-22CCSDK-1864 : PNF Use Case Move from Jython to Kotlin using CDS Frameworkgummar2-4/+11
Change-Id: I58eb134a07345d25be6d64dc614f25fc73ecf554 Signed-off-by: gummar <raj.gumma@est.tech> Issue-ID: CCSDK-1864
2019-11-21Bootstrap Rest and GRPC APIBrinda Santh2-13/+4
CDS loads model types, dictionaries and CBA multiple times based on cluster size. This commits avoid auto loading, and provides an API to bootstrap, if necessity. Issue-ID: CCSDK-1950 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: Ibe6266ebfd399efbaf0c5ccb1019c3a73b08ddac
2019-11-18Property based GRPC server service.Brinda Santh1-1/+1
Issue-ID: CCSDK-1747 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I948d4fac974a0d6d0c855ad4e24766a9ce6b7a6a
2019-11-07Add rest client invocation log tracing.Brinda Santh3-10/+18
Issue-ID: CCSDK-1046 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: Ie44a1b2628132aa44bc923a4d622544db03b46b0
2019-11-07Merge "Update on Health-api"Dan Timoney4-3/+85
2019-11-07Merge "Refractor rest log tracing filter for reuse."Dan Timoney1-18/+2
2019-11-06Update on Health-apiShaaban Ebrahim4-3/+85
-add Combined health check -add combined metrics check Issue-ID: CCSDK-1669 Signed-off-by: Shaaban Ebrahim <shaaban.eltanany.ext@orange.com> Change-Id: Idb3c7f67b3f22bd6069f75c193ae458c346fb2ac
2019-11-05Rolling upgrade support for in-flight requestsSebastien Premont-Tendland3-15/+13
Three entry points are being handled : 1 - REST endpoint 2 - gRPC endpoint 3 - Kafka consumer We make use of Phaser object to make sure the PreDestroy callback wait for all requests to be executed before stopping the process. The docker image was also modified to make sure the java process becomes PID 1 in the container in order to catch the SIGTERM signal which triggers the PreDestroy callback of Spring. This was done by using the "exec" command in bash. Issue-ID: CCSDK-1885 Signed-off-by: Sebastien Premont-Tendland <sebastien.premont@bell.ca> Change-Id: I3e2a72e26a4c8b7768ebc374ea40aa8d55fb6761
2019-11-01Refractor rest log tracing filter for reuse.Brinda Santh1-18/+2
Issue-ID: CCSDK-1046 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I0ef0627851041b80f63c907c165c9eff5972a973
2019-10-31Merge "Py executor grpc TLS server authentication."Dan Timoney1-1/+5
2019-10-31Merge "Add GRPC log tracing service."Dan Timoney2-2/+4
2019-10-30Removed all http_proxy reference from build.Sebastien Premont-Tendland1-4/+1
http_proxy is an environment configuration and should not be defined in in the build script. If you need to use a proxy to build docker images then add it to the mvn command like this : -Ddocker.buildArg.http_proxy=$PROXY -Ddocker.buildArg.https_proxy=$PROXY Also adding http_proxy in the Dockerfile directly will add the environment variable in the POD statically using the proxy the was built with at runtime. If a proxy is needed at runtime then the environment variables should be injecting using helm charts and overrides. Issue-ID: CCSDK-1877 Signed-off-by: Sebastien Premont-Tendland <sebastien.premont@bell.ca> Change-Id: I2b99b277b594408c974cf29a5804384293776a22
2019-10-24Merge "Implemented UAT runtime services"Brinda Santh Muthuramalingam21-290/+1196
2019-10-22Py executor grpc TLS server authentication.Brinda Santh1-1/+5
Issue-ID: CCSDK-1854 Signed-off-by: Brinda Santh <bs2796@att.com> Change-Id: I72b3deb7976e7d3e44478c497a46b9b4ac428623