summaryrefslogtreecommitdiffstats
path: root/components/datalake-handler/feeder/src/main
AgeCommit message (Collapse)AuthorFilesLines
2019-06-10Druid Kafka Indexing Service Supervisor Spec for topicGuobiao Mo5-186/+1795
HW and EPC Issue-ID: DCAEGEN2-1598 Change-Id: Iee4a3a3efc2aa04afb1ab234070cd393ca110055 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-06-06Merge "Dashboard and esTemplate"Yan Yang18-0/+1169
2019-06-06Dashboard and esTemplateZhangZihao18-0/+1169
Change-Id: Id87cb7846ac50ab5e0deee9582479c41aa4e5484 Issue-ID: DCAEGEN2-1329 Signed-off-by: ZhangZihao <zhangzihao@chinamobile.com>
2019-06-04Flatten and Aggregate features in JSON array processingGuobiao Mo8-7/+250
Issue-ID: DCAEGEN2-1598 Change-Id: I9f563bcfa18285daf7b48878e8427bfdb1aff21f Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-05-30Unit tests to improve sonar coverageGuobiao Mo4-9/+11
Issue-ID: DCAEGEN2-1468 Change-Id: Ie322142a2298ca55d32d64861e71ebc64cd8c09e Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-05-26Dynamically detect topic updates and new topicsGuobiao Mo12-149/+362
Issue-ID: DCAEGEN2-1195 Change-Id: I35d36a9aafe3a7681a9d4745bc509aded111b29d Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-05-22Bug fixKate Hsuan4-15/+30
1. Fix feeder start/stop exceptions- "The Kafka consumer is NOT thread-safe" exception. 2. Modify REST format for feeder start/stop/status. Issue-ID: DCAEGEN2-1437 Change-Id: I7f79243a0098e6fa17b06866ef6dfc3f71b20dc8 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-17Dependency fixKate Hsuan1-1/+1
1. Change spring boot version 2.1.4->2.1.0. 2. Modify URL of list dmaap. Issue-ID: DCAEGEN2-1437 Change-Id: Ieeb28a3cf4c9441d00b6eb278dcb067e391175df Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-16Bug fixKate Hsuan1-0/+1
1. Close zookeeper connection. Issue-ID: DCAEGEN2-1437 Change-Id: I7a2bfdcf14203cbe1708e6148b12ea00c49a07a1 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-14Set HDFS userGuobiao Mo1-2/+4
Use DB.login as HDFS write user. Issue-ID: DCAEGEN2-1498 Change-Id: I59ee83472595b1fc79e9562b68f4178e7fbd920b Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-05-13Support HDFS as a data storeGuobiao Mo12-126/+338
Issue-ID: DCAEGEN2-1498 Change-Id: Id203275bce01bd4a4d6ec131fb9696d78eda82f5 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-05-10Bug fixKate Hsuan2-2/+3
1. Fix DB config JSON and config format. Issue-ID: DCAEGEN2-1437 Change-Id: I3bf0778c61811cc636099d2dbd118fec49d72625 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-09Bug fixKate Hsuan4-2/+34
1. Add a topic delete API. 2. Fix JSON response body. 3. Fix DB config update. Issue-ID: DCAEGEN2-1437 Change-Id: I4cd5710baf796c8a6bcc9af5283a36bd37659ec8 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-07Merge "Add dashboard template configuration schema"Yan Yang1-0/+3
2019-05-07Add dashboard template configuration schemaKate Hsuan1-0/+3
Issue-ID: DCAEGEN2-1329 Change-Id: I29ef46a44a61ef7adceeabe6b65d406d07902be2 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-02Handle duplicate idGuobiao Mo4-99/+103
Issue-ID: DCAEGEN2-1411 Change-Id: Ib39b39ff276d7d5c3dbfaa281df6104926fa354d Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-29Use TopicConfig in backend4.0.0-ONAP1.0.0Guobiao Mo12-165/+159
Issue-ID: DCAEGEN2-1200 Change-Id: Ia18993524c272c42ba48485a636f04f94af0cd0a Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-29Modify TopicConfigGuobiao Mo5-64/+73
Issue-ID: DCAEGEN2-1309 Change-Id: Iccfd579f71e0ca971851ba66443973bdd67dcced Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-27Merge "Unit test code for datalake seed code"Yan Yang1-25/+26
2019-04-26Add Topic configuration APIKate Hsuan6-110/+227
1. Add Topic configuration APIs 2. Remove the "default_topic" DB relationship 3. Fix unit test Issue-ID: DCAEGEN2-1437 Change-Id: I7f992a2439606a1e35dc015e0296ca86375caa87 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-04-26Unit test code for datalake seed codeRama-Huawei1-25/+26
Improved Feeder Controller code coverage to 100% Added null check for if no consumer records avaliable then no need to process further Issue-ID: DCAEGEN2-1309 Change-Id: Ib3eac572f1a008f9e3c958a483ce3bc1e313a904 Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-26Merge "‘correlateClearedMessage’"Yan Yang3-17/+101
2019-04-25‘correlateClearedMessage’ZhangZihao3-17/+101
Change-Id: I32ea4043d32f29c920b370de3c84341c218ed5c2 Issue-ID: DCAEGEN2-1190 Signed-off-by: ZhangZihao <zhangzihao@chinamobile.com>
2019-04-24Remove explicit dependency on com.couchbase.client/core-ioGuobiao Mo1-3/+1
let org.springframework.data/spring-data-couchbase take care of Couchbase dependencies. Issue-ID: DCAEGEN2-1309 Change-Id: I0e6ba6198bb30a5cc69bdc6202f23df6c8c46e85 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-243 data mappings for ESGuobiao Mo4-5/+69
Issue-ID: DCAEGEN2-1329 Change-Id: I6100362ad58b6e0eae7f86decca4a4dfc9db6102 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-23Move hard-coded strings to app configurationGuobiao Mo9-56/+86
Issue-ID: DCAEGEN2-1452 Change-Id: I6577ba3b5a8f877bbaa13d0c590d6a2072331136 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-23Add REST API calls for DB manipulation.Kate Hsuan8-65/+283
1. Add the REST APIs for DB configuration. 2. Fix ORM relationship. Issue-ID: DCAEGEN2-1437 Change-Id: Iae842921aa671419e57f569093ecdd74dea4f8d2 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-04-17Unit test to improve sonar coverageGuobiao Mo8-38/+18
Issue-ID: DCAEGEN2-1309 Change-Id: Ia3651bb105d92013d6d2a9d60fffe3b6066adf64 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-16Unit test code for datalake seed codeRama-Huawei5-106/+1096
Fixed the folder related path for generating and reading files from correct folder Issue-ID: DCAEGEN2-1309 Change-Id: I1ec3aae549f484e667eb4048c1ab59b6a60aaf87 Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-15Fix Mongo connection methodKate Hsuan1-5/+26
Address and credential must be a list. Issue-ID: DCAEGEN2-1411 Change-Id: I5705d4086476ea02d9eb54c0cf4c329c1848f5cf Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-04-14Introduce global SSL flagGuobiao Mo3-8/+21
Issue-ID: DCAEGEN2-1411 Change-Id: Ic7723aeb2c5aa9012d969432c3cc3846a49f728f Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-10MongoDB Authentication and SSLGuobiao Mo3-4/+35
Issue-ID: DCAEGEN2-1411 Change-Id: I881cc0e1dd3d7c012a08307bb289f7f97f9c96d5 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-10Support MongoDB as a data storageGuobiao Mo8-60/+238
Issue-ID: DCAEGEN2-1411 Change-Id: I06b69605e88d5b81500b788847e7c90ff4017a07 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-08Integrate Swagger for REST APIGuobiao Mo5-37/+121
Issue-ID: DCAEGEN2-1400 Change-Id: Idd68e1f50b6572dcd4c2e17291628810f3813dba Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-07Use MariaDB to store application configurationsGuobiao Mo24-264/+761
Issue-ID: DCAEGEN2-1400 Change-Id: I86b5bc25d84b98f7ac84b95f1690089dcebe7f0a Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-03-29Unit test for seed codeGuobiao Mo5-21/+128
This project depends heavily on outside infrastructure, thus there are not much unit test cases. Issue-ID: DCAEGEN2-1309 Change-Id: I8893f4029014673139e67bf373fd77e9e5c42f83 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-03-26DataLake seed codeGuobiao Mo28-0/+3201
Issue-ID: DCAEGEN2-1189 Change-Id: Ib25b70197e3b162efadbce0f1b5235e3ba6635e9 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>