aboutsummaryrefslogtreecommitdiffstats
path: root/vnfs/DAaaS
AgeCommit message (Collapse)AuthorFilesLines
2020-03-23Removing unused imports in python scriptsBartek Grzybowski3-10/+0
Removing according to pylint report. Change-Id: I2296b923a71c53347afcd0eb11d1c07b1400570f Issue-ID: INT-1482 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-03-23Fix whitespace issues in Python filesBartek Grzybowski8-14/+12
Change-Id: I7c98d1187c24b58471a822ec6f0fb9b0999f6f39 Issue-ID: INT-1482 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-03-23Pretty print json files in vnfs/Bartek Grzybowski6-1666/+1676
Fixing json files to conform to linter rules. Change-Id: I88556796ebf7737bc82db1ab0675b943061c6354 Issue-ID: INT-1482 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2019-11-14First working draft of kafka for inference appRajamohan Raj12-0/+301
Created a python based inference app which can query a given metrics for a given duration from kafka topic. Consumer runs on separate thread and doesnt interfere with the main app. Issue-ID: ONAPARC-528 Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com> Change-Id: Ic84ea137b134385246bf11dee2ed6d34b593b956
2019-11-13Remote Write Config and Filter operatorDileep Ranganathan17-455/+604
Added support for Kafka Remote writer Issue-ID: ONAPARC-393 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I46555a15b0f326ffcd305d28e82d244c86a34644
2019-11-13Add/update/delete PrometheusRemoteEndpoint CRSrivahni33-0/+2483
PrometheusRemoteEndpoint CR when applied, a remote write endpoint is added/updated/deleted in prometheus. Issue-ID: ONAPARC-393 Signed-off-by: Srivahni <srivahni.chivukula@intel.com> Change-Id: I8cdc0b673b35be3457a2b12c6769cd3cf62ac6c5
2019-11-11Helm charts for Prometheus Kafka Remote WriterDileep Ranganathan9-46/+181
Added Helm charts for prom-kafka-writer micro service. Removed older kafka adapter due to inflexibility. Issue-ID: ONAPARC-392 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I6f8e33a5e096c6b88badb29718e1e7ce126889fd
2019-11-11Prometheus Kafka Writer MicroserviceDileep Ranganathan20-0/+1582
This patch implents Prometheus to remote Kafka Writer Microservice Added sample day-2 config to configure prometheus PS4: Fixed Review comments Issue-ID: ONAPARC-393 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I0bc77175593a165effd7bb1cb4802c988a5ef4ec
2019-11-04HDFS-WriterApp-Fixed all the code review commentsRajamohan Raj10-253/+225
Fixed all the code review comments by Kiran 1. Implemented a boolean channel instead of empty struct channel for signal, use WaitGroup to ensure all writers finish cleanup. 2. Introduce JSON tags for configs 4. remove all panic and fatalf code to ensure that the app doesnt crash anytime. 5. remove unneccessary hdfsWriter null checks. 6.remove the 'run' variable used in the infinite loop, replaced with 'return' Issue-ID: ONAPARC-453 Change-Id: Ic77c59dc75a8898a3cf34999850e6687d40e7faa Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com>
2019-10-24Adding Istio installtion helm chartsPramod52-2511/+1802
Issue-ID: ONAPARC-521 Signed-off-by: Pramod <pramod.raghavendra.jayathirth@intel.com> Change-Id: I1f74190664d59465319bff77d65282a2437ade4d
2019-10-15HDFSWriter microservice working copyRajamohan Raj25-122/+699
Issue-ID: ONAPARC-453 Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com> Change-Id: I11c91b642e466763c1ca6f5734bf81fb260e2b39
2019-10-14Change NodePort to ClusterIP in coll, promOper pkgSrivahni4-11/+12
Issue-ID: ONAPARC-393 Signed-off-by: Srivahni <srivahni.chivukula@intel.com> Change-Id: Ica0be8d255074b78dede3fd3b0045f41fde02136
2019-10-09Added Istio config for multicluster connectivityDileep Ranganathan28-0/+656
1. Collection package 2. Kafka 3. M3DB Issue-ID: ONAPARC-466 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I3ef5722f207a930437ddc7c01e22609772f97865
2019-10-09Add Istio connectivity for Services belowPramod21-0/+543
1. Grafana 2. Prometheus 3. Minio (Istio ServiceEntry Added) Issue-ID: ONAPARC-511 Signed-off-by: Pramod <pramod.raghavendra.jayathirth@intel.com> Change-Id: I2cb21c18fde6ecb431fa7f407ce5e13ab31fc910
2019-10-08Collectd Operator Unit TestsDileep Ranganathan13-15/+1001
Added unit tests for Collectd operator. Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: Ib50c16eaefc661e077d3477cbe8f2e4e62bbda80
2019-10-01Added Daemonset Status predicateDileep Ranganathan5-53/+164
Added Daemonset Status predicate to optimize watch on DS. Minor fixes on status update for the controllers by coalescing status and CR update together. Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I2a56f0b93c2d7a56b9e8149c41f8c6f22be86ef1
2019-09-20Updated READMESrivahni2-11/+55
Issue-ID: ONAPARC-393 Signed-off-by: Srivahni <srivahni.chivukula@intel.com> Change-Id: Ic6578a4b0484b22109bd5a385f0917db8cff14f5
2019-09-19Enable/disable grafana and visualization-operatorSrivahni4-0/+22
Enable or disable grafana and visualization-operator from values.yaml Issue-ID: ONAPARC-393 Signed-off-by: Srivahni <srivahni.chivukula@intel.com> Change-Id: I28599c497fc247ec6d9fbfb9e0449d1b0f736d3e
2019-09-10update README for visualization-operator imageSrivahni1-2/+2
Issue-ID: ONAPARC-393 Signed-off-by: Srivahni <srivahni.chivukula@intel.com> Change-Id: I6a2561cedd7958c6f262a3a3568d20992af1b69f
2019-09-09Bug Fix - Daemonset not reloadingDileep Ranganathan3-58/+41
Fixed issue related to Daemonset reloading due to a bug introduced in the previous patch. Removed redundant watches across multiple controllers. Used defer statement instead of calling mutex unlock. Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I7ef6d4e640d6190da34cc70d5a7cf80a96c004bd
2019-09-06Helm chart for visualization-operatorSrivahni10-0/+306
Issue-ID: ONAPARC-393 Signed-off-by: Srivahni <srivahni.chivukula@intel.com> Change-Id: If841ce54d5d6da4576484084330f401ea537da86
2019-09-06Visualization operator - update/delete datasourceSrivahni8-25/+201
Added support in the visualization operator to update or delete an existing grafana datasource dynamically. Issue-ID: ONAPARC-393 Signed-off-by: Srivahni <srivahni.chivukula@intel.com> Change-Id: I814cca8e5b4f7f5832a948449cf545cecd25b1f9
2019-09-06Fix issue with concurrent CR creationDileep Ranganathan8-136/+92
The collectd operator is going into deadlock when concurrent update operations happen within the same controller trying to update the resource. Fixed this by adding Mutex. Deleted the old build_image.sh which is replaced by new script which builds and pushes from inside a builder docker container. This helps in tackling the dependency issues for image build. Updated the README for build image script usage. Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: Ib3c2d1edd266e70bb713885de7ad046ebf5ad086
2019-09-06DAaaS: Fixed various minor issues in visulizationLianhao Lu24-2/+13
1. Adjust the directory layout for the example value file of grafana-values.yaml introduced by commit d372a21. 2. Fix the file mode. Issue-ID: ONAPARC-393 Change-Id: Iedaa54e1b89fbd8f2c62cbdc4a025c29bbd31482 Signed-off-by: Lianhao Lu <lianhao.lu@intel.com>
2019-09-06visualization operator: Add datasourceSrivahni19-13/+904
Added support to create a grafana datasource dynamically using GrafanaDataSource CR. Issue-ID: ONAPARC-393 Signed-off-by: Srivahni <srivahni.chivukula@intel.com> Change-Id: Iaa645c5c4f303afbcec114c00e35cd6e6ae6c98c
2019-08-30Fixed the imagePullPolicyDileep Ranganathan1-1/+1
Fixed the imagePullPolicy from Always to IfNotPresent Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: Id44ecc39a5df61f985caea0ad087e3a571308c4b
2019-08-30Added docker image builder for go MSDileep Ranganathan2-0/+51
Added builder image and script to build golang based microservice images Issue-ID: ONAPARC-366 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I90bd0cfbd5dfbe1d5a4233673e68fac1bc60accf
2019-08-28Fixed pacakge issue in openapi gen codeDileep Ranganathan1-12/+12
Fixed internal package issue in openapi gen code Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I5adb51784766c21ad7184ce328f809c44aabf893
2019-08-27Add readme for configuring collectd-operatorDileep Ranganathan1-1/+19
Add readme for configuring collectd-operator Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I351577055eb6a93326c3243c42f4149dc06b6b27
2019-08-27Collectd-Operator build script and ReadmeDileep Ranganathan3-2/+41
Added build image script for offline build and CI. Added readme instructions on how to build, deploy and use collectd-operator. Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: Ifd1b9dc22bdf6005125931527c052727ee11a323
2019-08-27Helm Chart for Istio with SDSPramod6-3/+201
Helm is installed using the Istio operator Secret Discovery Service - SDS is used in Istio for identity provisioning and Certificate rotation Issue-ID: ONAPARC-504 Signed-off-by: Pramod <pramod.raghavendra.jayathirth@intel.com> Change-Id: I4cabd26ccefbbb87ef02cba58e17b5c4a9ef0e34
2019-08-19Sample Application to save model to MinioDileep Ranganathan13-0/+464
Sample Application to save model to Minio Change-Id: Ieb5fe409564bfe363c4fd3fbab165d9c89ad5c37 Issue-ID: ONAPARC-460 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com>
2019-08-19DAaaS: added toleration support for m3dbLianhao Lu2-0/+3
Issue-ID: ONAPARC-393 Signed-off-by: Lianhao Lu <lianhao.lu@intel.com> Change-Id: I1d31f95ac8580ec67f9f2f57b9db37806dc70ea0
2019-08-14Update README for installing M3DBDileep Ranganathan1-13/+75
Updated installation steps for M3DB. Issue-ID: ONAPARC-280 Change-Id: I7370c72e1aaee46234b2e9e67eba697cecd85887 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com>
2019-08-12Helm charts for Collectd OperatorDileep Ranganathan11-0/+366
Helm charts for Collectd Operator Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: Icd1fc169f9e005030a0d2b48cf9dd76434bf6ba3 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com>
2019-08-12Upgraded Daemonset apiversion to apps/v1Dileep Ranganathan4-11/+9
Upgraded Daemonset apiversion to apps/v1 Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I6cf5d355808fb0c86bfb469018ae570c6f7465f7
2019-08-12Collectd Operator - Added TypesDB feature supportDileep Ranganathan14-19/+148
Added support for typesDB. CollectGlobal CR can now add, update, delete TypesDB and custom TypesDB to the conf. This is achieved via creating a configmap for the types.db files and then passing the configmap name in the CR Spec. Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: Idb27d7981c72f67863f193bd5013f6907362ede9
2019-08-12Upgrade operator-sdk bump version to 0.9.0Dileep Ranganathan13-146/+389
Upgrade operator-sdk bump version to 0.9.0 Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I2b137599c3df9a0332862f46c5ac54892eeb5de2
2019-08-11Added GenerationChangePredicate for CollectdPluginDileep Ranganathan1-1/+2
Added Predicate to discard events for status update Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I867b321de4b0a461ec6d0264e98761b5cdc01b77
2019-08-11Collectd Global CRDDileep Ranganathan11-185/+913
This patch introduces an enhancement to the existing Collectd Operator. It has now 2 CRDS CollectdGlobal and CollectdPlugin and corresponding controllers. CollectdGlobal is used to specify the global options of collectd conf and CollectdPlugin is used to load/unload plugins. Added synchronization when both controllers try to fetch the same resources. Refactored some of the common code to collectdutils. Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: Id2edf6fa6de56d9d7216ebb258b3017661c6a3dd
2019-08-11Skeletal code for visualization-operatorSrivahni15-0/+988
This visualization-operator(based on operator-sdk) when deployed, should be able to manage(add/update/delete) the datasources dynamically without restarting the grafana pods. Issue-ID: ONAPARC-393 Signed-off-by: Srivahni <srivahni.chivukula@intel.com> Change-Id: I2df3659aca5dd9ad59cf58adaf3c30999829fa2f
2019-08-06Helm charts for MetallbPramod12-0/+704
Metallb is a loadbalancer for Kubernetes Issue-ID: MULTICLOUD-747 Signed-off-by: Pramod <pramod.raghavendra.jayathirth@intel.com> Change-Id: If5501da743ad37c6e343a0f460f0674d1554704c
2019-08-06Helm chart for Istio OperatorPramod13-30/+1654
Operator is required to manage the lifecycle fo Istio deployments Issue-ID: MULTICLOUD-710 Signed-off-by: Pramod <pramod.raghavendra.jayathirth@intel.com> Change-Id: I9ea2427eb88caf06c41fcf2fb6f0cc0c66e8fb96
2019-07-30DAaaS: enhance collectd to be more configurableLianhao Lu4-35/+84
Enhance the collectd chart in DAaaS to be more configurable, so that it can be launched with k8s CMK environment. Issue-ID: ONAPARC-393 Signed-off-by: Lianhao Lu <lianhao.lu@intel.com> Change-Id: I28698688a9977f60e89c54f32c1de73c17cb6751
2019-07-22DAaaS: Added the guidelines for kafka operatorsRajamohan Raj1-0/+58
DAaaS : Added the required steps in the main readme for strimzi based kafka operator and kafka. Issue-ID: ONAPARC-391 Change-Id: I05dfc201e8859407b22dd5683761efd775ed4f24 Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com>
2019-07-22DAaaS: Fixing dashborad provisioningLianhao Lu1-1/+1
Fixed the incorrected indent of provisioning dashboards in json format directly. Change-Id: I092390305eda5ac086380662132c914bff61182a Issue-ID: ONAPARC-393 Signed-off-by: Lianhao Lu <lianhao.lu@intel.com>
2019-07-22Added Status Handler for Collectd OperatorDileep Ranganathan4-50/+170
Added status handler for secodary resources like Daemonset updates Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I8b5cac7dde9afe355be9468fc5c925b658c78fc6
2019-07-19Adding few troubleshooting guidelines for HDFS.Rajamohan Raj2-0/+91
Issue-ID: ONAPARC-391 Change-Id: Ic4cd3376aa668b46da1890a09aaf3f461a04e254 Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com>
2019-07-19DAaaS: Fixing dashborad provisioningLianhao Lu1-2/+3
Fixed the multiline indicator usage that breaks the provisioning grafana dashboards from local file. Change-Id: If97f06119b10dad70eea74f68b180280978ad1c7 Issue-ID: ONAPARC-393 Signed-off-by: Lianhao Lu <lianhao.lu@intel.com>
2019-07-17Automate datasource & dashboard imports in grafanaSrivahni5-12/+210
Added to grafana-values.yaml Issue-ID: ONAPARC-393 Signed-off-by: Srivahni <srivahni.chivukula@intel.com> Change-Id: Id6c8413ea4c4ea69cc7b35f52c2f47b364f5906f