summaryrefslogtreecommitdiffstats
path: root/vnfs/DAaaS/microservices
AgeCommit message (Collapse)AuthorFilesLines
2019-11-14First working draft of kafka for inference appRajamohan Raj12-0/+301
Created a python based inference app which can query a given metrics for a given duration from kafka topic. Consumer runs on separate thread and doesnt interfere with the main app. Issue-ID: ONAPARC-528 Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com> Change-Id: Ic84ea137b134385246bf11dee2ed6d34b593b956
2019-11-13Remote Write Config and Filter operatorDileep Ranganathan17-455/+604
Added support for Kafka Remote writer Issue-ID: ONAPARC-393 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I46555a15b0f326ffcd305d28e82d244c86a34644
2019-11-13Add/update/delete PrometheusRemoteEndpoint CRSrivahni33-0/+2483
PrometheusRemoteEndpoint CR when applied, a remote write endpoint is added/updated/deleted in prometheus. Issue-ID: ONAPARC-393 Signed-off-by: Srivahni <srivahni.chivukula@intel.com> Change-Id: I8cdc0b673b35be3457a2b12c6769cd3cf62ac6c5
2019-11-11Prometheus Kafka Writer MicroserviceDileep Ranganathan19-0/+1572
This patch implents Prometheus to remote Kafka Writer Microservice Added sample day-2 config to configure prometheus PS4: Fixed Review comments Issue-ID: ONAPARC-393 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I0bc77175593a165effd7bb1cb4802c988a5ef4ec
2019-11-04HDFS-WriterApp-Fixed all the code review commentsRajamohan Raj10-253/+225
Fixed all the code review comments by Kiran 1. Implemented a boolean channel instead of empty struct channel for signal, use WaitGroup to ensure all writers finish cleanup. 2. Introduce JSON tags for configs 4. remove all panic and fatalf code to ensure that the app doesnt crash anytime. 5. remove unneccessary hdfsWriter null checks. 6.remove the 'run' variable used in the infinite loop, replaced with 'return' Issue-ID: ONAPARC-453 Change-Id: Ic77c59dc75a8898a3cf34999850e6687d40e7faa Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com>
2019-10-15HDFSWriter microservice working copyRajamohan Raj23-117/+694
Issue-ID: ONAPARC-453 Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com> Change-Id: I11c91b642e466763c1ca6f5734bf81fb260e2b39
2019-10-08Collectd Operator Unit TestsDileep Ranganathan12-15/+1000
Added unit tests for Collectd operator. Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: Ib50c16eaefc661e077d3477cbe8f2e4e62bbda80
2019-10-01Added Daemonset Status predicateDileep Ranganathan5-53/+164
Added Daemonset Status predicate to optimize watch on DS. Minor fixes on status update for the controllers by coalescing status and CR update together. Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I2a56f0b93c2d7a56b9e8149c41f8c6f22be86ef1
2019-09-09Bug Fix - Daemonset not reloadingDileep Ranganathan3-58/+41
Fixed issue related to Daemonset reloading due to a bug introduced in the previous patch. Removed redundant watches across multiple controllers. Used defer statement instead of calling mutex unlock. Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I7ef6d4e640d6190da34cc70d5a7cf80a96c004bd
2019-09-06Visualization operator - update/delete datasourceSrivahni7-24/+199
Added support in the visualization operator to update or delete an existing grafana datasource dynamically. Issue-ID: ONAPARC-393 Signed-off-by: Srivahni <srivahni.chivukula@intel.com> Change-Id: I814cca8e5b4f7f5832a948449cf545cecd25b1f9
2019-09-06Fix issue with concurrent CR creationDileep Ranganathan7-134/+90
The collectd operator is going into deadlock when concurrent update operations happen within the same controller trying to update the resource. Fixed this by adding Mutex. Deleted the old build_image.sh which is replaced by new script which builds and pushes from inside a builder docker container. This helps in tackling the dependency issues for image build. Updated the README for build image script usage. Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: Ib3c2d1edd266e70bb713885de7ad046ebf5ad086
2019-09-06visualization operator: Add datasourceSrivahni17-12/+888
Added support to create a grafana datasource dynamically using GrafanaDataSource CR. Issue-ID: ONAPARC-393 Signed-off-by: Srivahni <srivahni.chivukula@intel.com> Change-Id: Iaa645c5c4f303afbcec114c00e35cd6e6ae6c98c
2019-08-30Added docker image builder for go MSDileep Ranganathan2-0/+51
Added builder image and script to build golang based microservice images Issue-ID: ONAPARC-366 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I90bd0cfbd5dfbe1d5a4233673e68fac1bc60accf
2019-08-28Fixed pacakge issue in openapi gen codeDileep Ranganathan1-12/+12
Fixed internal package issue in openapi gen code Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I5adb51784766c21ad7184ce328f809c44aabf893
2019-08-27Collectd-Operator build script and ReadmeDileep Ranganathan2-2/+31
Added build image script for offline build and CI. Added readme instructions on how to build, deploy and use collectd-operator. Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: Ifd1b9dc22bdf6005125931527c052727ee11a323
2019-08-12Upgraded Daemonset apiversion to apps/v1Dileep Ranganathan4-11/+9
Upgraded Daemonset apiversion to apps/v1 Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I6cf5d355808fb0c86bfb469018ae570c6f7465f7
2019-08-12Collectd Operator - Added TypesDB feature supportDileep Ranganathan14-19/+148
Added support for typesDB. CollectGlobal CR can now add, update, delete TypesDB and custom TypesDB to the conf. This is achieved via creating a configmap for the types.db files and then passing the configmap name in the CR Spec. Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: Idb27d7981c72f67863f193bd5013f6907362ede9
2019-08-12Upgrade operator-sdk bump version to 0.9.0Dileep Ranganathan13-146/+389
Upgrade operator-sdk bump version to 0.9.0 Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I2b137599c3df9a0332862f46c5ac54892eeb5de2
2019-08-11Added GenerationChangePredicate for CollectdPluginDileep Ranganathan1-1/+2
Added Predicate to discard events for status update Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I867b321de4b0a461ec6d0264e98761b5cdc01b77
2019-08-11Collectd Global CRDDileep Ranganathan11-185/+913
This patch introduces an enhancement to the existing Collectd Operator. It has now 2 CRDS CollectdGlobal and CollectdPlugin and corresponding controllers. CollectdGlobal is used to specify the global options of collectd conf and CollectdPlugin is used to load/unload plugins. Added synchronization when both controllers try to fetch the same resources. Refactored some of the common code to collectdutils. Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: Id2edf6fa6de56d9d7216ebb258b3017661c6a3dd
2019-08-11Skeletal code for visualization-operatorSrivahni15-0/+988
This visualization-operator(based on operator-sdk) when deployed, should be able to manage(add/update/delete) the datasources dynamically without restarting the grafana pods. Issue-ID: ONAPARC-393 Signed-off-by: Srivahni <srivahni.chivukula@intel.com> Change-Id: I2df3659aca5dd9ad59cf58adaf3c30999829fa2f
2019-07-22Added Status Handler for Collectd OperatorDileep Ranganathan4-50/+170
Added status handler for secodary resources like Daemonset updates Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I8b5cac7dde9afe355be9468fc5c925b658c78fc6
2019-06-26Fixed Label selector for Collectd OperatorDileep Ranganathan2-17/+50
Fixed issue with hard-coded label selector Current solution expects the label selector to be passed from environment variable inside the operator container, else will use the default label selector. Added more robust error handling. Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: Ic99042c4fb4770e47504bdecf960c6ea8619431e
2019-06-25Added CollectdPlugin delete event handlerDileep Ranganathan7-33/+136
Features added: Added finalizer to handle deletion event Added status subresource handling Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: Id0ada92ce077c9d7573be385dc92a9812800d970
2019-06-21Sample CollectdPlugin CR for write_prometheusDileep Ranganathan1-0/+12
Added sample custom resource CollectdPlugin for enabling write_prometheus Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I9a037beb1efd7abd1842c7b4941377174444a1b4
2019-06-21Rebuild conf from CollectdPlugins CRDDileep Ranganathan2-9/+48
Added feature to rebuild collectd conf and rolling update the Daemonset Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I24e25b2afc61e18e04be91d7de4b41f928e845ee
2019-06-19Added more features to Collectd OperatorDileep Ranganathan1-55/+41
Feature - rolling update of Collectd Daemonset based on CRD changes. Added CollectdPlugins to the resource map Bug Fix - Removed the OwnerReference for secondary resources. Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: Ic5e03b331c98fbd77a6fb694db0035b136e34c0a
2019-06-19Added support for Operator SDK debuggingDileep Ranganathan1-1/+3
Added local build for Operator SDK debugging Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: Icd5a973bf04372cf7c9fe7d2a052930198b236a6
2019-06-12Fix the Collectd operator panic issueDileep Ranganathan6-12/+31
Fixed the panic issue as the daemonset was used instead of DaemonsetList. Improved the logging to get data from configmap. Filters used to query ConfigMap was wrong. Issue-ID: OPTFRA-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: I14807f7b254ccc0636b5cef6d58b4b6cc0c0e375
2019-05-31Fix collectd-operator build issueDileep Ranganathan11-31/+58
Fix build issues. Version control some files which were .gitignored. Issue-ID: ONAPARC-461 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com> Change-Id: Ia7d1b9ef0e518c1afea5ca91103309724111028c
2019-05-30Refactor Distributed Analytics project structureDileep Ranganathan29-0/+1550
Modified the project structure to improve maintainability and to add future CI and integration test support. Change-Id: Id30bfb1f83f23785a6b5f99e81f42f752d59c0f8 Issue-ID: ONAPARC-280 Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com>