summaryrefslogtreecommitdiffstats
path: root/components/datalake-handler/feeder
AgeCommit message (Collapse)AuthorFilesLines
2019-06-06Dashboard and esTemplateZhangZihao18-0/+1169
Change-Id: Id87cb7846ac50ab5e0deee9582479c41aa4e5484 Issue-ID: DCAEGEN2-1329 Signed-off-by: ZhangZihao <zhangzihao@chinamobile.com>
2019-06-05Bug fixKate Hsuan1-1/+1
Elasticsearch Type should be "doc" Issue-ID: DCAEGEN2-1598 Change-Id: If62b18d60f065e37af15c19597bcc798949d9ade Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-06-04Flatten and Aggregate features in JSON array processingGuobiao Mo14-18/+296
Issue-ID: DCAEGEN2-1598 Change-Id: I9f563bcfa18285daf7b48878e8427bfdb1aff21f Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-05-30Unit tests to improve sonar coverageGuobiao Mo11-106/+499
Issue-ID: DCAEGEN2-1468 Change-Id: Ie322142a2298ca55d32d64861e71ebc64cd8c09e Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-05-28DB schema updateGuobiao Mo1-11/+24
Since the terms 'dashboard' and 'template' are used in some dashboard_template entries. Rename: dashboard -> portal dashboard_type -> design_type dashboard_template -> portal_design Issue-ID: DCAEGEN2-1329 Change-Id: Icaa0874ce652cf95f3989712a23412db362b8db5 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-05-26Dynamically detect topic updates and new topicsGuobiao Mo17-188/+405
Issue-ID: DCAEGEN2-1195 Change-Id: I35d36a9aafe3a7681a9d4745bc509aded111b29d Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-05-22Bug fixKate Hsuan5-18/+36
1. Fix feeder start/stop exceptions- "The Kafka consumer is NOT thread-safe" exception. 2. Modify REST format for feeder start/stop/status. Issue-ID: DCAEGEN2-1437 Change-Id: I7f79243a0098e6fa17b06866ef6dfc3f71b20dc8 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-17Dependency fixKate Hsuan1-1/+1
1. Change spring boot version 2.1.4->2.1.0. 2. Modify URL of list dmaap. Issue-ID: DCAEGEN2-1437 Change-Id: Ieeb28a3cf4c9441d00b6eb278dcb067e391175df Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-16Bug fixKate Hsuan1-0/+1
1. Close zookeeper connection. Issue-ID: DCAEGEN2-1437 Change-Id: I7a2bfdcf14203cbe1708e6148b12ea00c49a07a1 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-14Set HDFS userGuobiao Mo2-3/+5
Use DB.login as HDFS write user. Issue-ID: DCAEGEN2-1498 Change-Id: I59ee83472595b1fc79e9562b68f4178e7fbd920b Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-05-13Support HDFS as a data storeGuobiao Mo19-334/+579
Issue-ID: DCAEGEN2-1498 Change-Id: Id203275bce01bd4a4d6ec131fb9696d78eda82f5 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-05-10Bug fixKate Hsuan2-2/+3
1. Fix DB config JSON and config format. Issue-ID: DCAEGEN2-1437 Change-Id: I3bf0778c61811cc636099d2dbd118fec49d72625 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-09Bug fixKate Hsuan4-2/+34
1. Add a topic delete API. 2. Fix JSON response body. 3. Fix DB config update. Issue-ID: DCAEGEN2-1437 Change-Id: I4cd5710baf796c8a6bcc9af5283a36bd37659ec8 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-07Merge "Add dashboard template configuration schema"Yan Yang2-0/+41
2019-05-07Add dashboard template configuration schemaKate Hsuan2-0/+41
Issue-ID: DCAEGEN2-1329 Change-Id: I29ef46a44a61ef7adceeabe6b65d406d07902be2 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-03Merge "Handle duplicate id"Yan Yang6-103/+116
2019-05-03Merge "Unit test code for datalake seed code"Yan Yang1-0/+2
2019-05-02Handle duplicate idGuobiao Mo6-103/+116
Issue-ID: DCAEGEN2-1411 Change-Id: Ib39b39ff276d7d5c3dbfaa281df6104926fa354d Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-29Use TopicConfig in backend4.0.0-ONAP1.0.0Guobiao Mo19-213/+269
Issue-ID: DCAEGEN2-1200 Change-Id: Ia18993524c272c42ba48485a636f04f94af0cd0a Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-29Modify TopicConfigGuobiao Mo8-72/+80
Issue-ID: DCAEGEN2-1309 Change-Id: Iccfd579f71e0ca971851ba66443973bdd67dcced Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-27Merge "unit test of service"Yan Yang4-0/+341
2019-04-27Merge "Unit test code for datalake seed code"Yan Yang2-25/+141
2019-04-26Add Topic configuration APIKate Hsuan9-183/+267
1. Add Topic configuration APIs 2. Remove the "default_topic" DB relationship 3. Fix unit test Issue-ID: DCAEGEN2-1437 Change-Id: I7f992a2439606a1e35dc015e0296ca86375caa87 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-04-26Unit test code for datalake seed codeRama-Huawei1-0/+2
Improved Application Configuration code coverage to 100% Issue-ID: DCAEGEN2-1309 Change-Id: Ic42de3b39ba8468fa0c0749700a852ec0162e52b Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-26Unit test code for datalake seed codeRama-Huawei2-25/+141
Improved Feeder Controller code coverage to 100% Added null check for if no consumer records avaliable then no need to process further Issue-ID: DCAEGEN2-1309 Change-Id: Ib3eac572f1a008f9e3c958a483ce3bc1e313a904 Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-26unit test of serviceZhangZihao4-0/+341
Change-Id: Ie6a7838e242d96543c95f101e06e1b8c9e8d0099 Issue-ID: DCAEGEN2-1309 Signed-off-by: ZhangZihao <zhangzihao@chinamobile.com>
2019-04-26Merge "Unit test code for datalake seed code"Yan Yang1-0/+187
2019-04-26Merge "‘correlateClearedMessage’"Yan Yang4-17/+102
2019-04-25Unit test code for datalake seed codeRama-Huawei1-0/+187
Improved Topic Controller code coverage to 100% Issue-ID: DCAEGEN2-1309 Change-Id: I5abec6336c21c5dc664aaa2eba362ef900658576 Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-25Unit test code for datalake seed codeRama-Huawei1-0/+187
Improved DbController code coverage to 100% Issue-ID: DCAEGEN2-1309 Change-Id: I21e60fb4b02a44856a852bc6cba3f0d0d61680d2 Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-25‘correlateClearedMessage’ZhangZihao4-17/+102
Change-Id: I32ea4043d32f29c920b370de3c84341c218ed5c2 Issue-ID: DCAEGEN2-1190 Signed-off-by: ZhangZihao <zhangzihao@chinamobile.com>
2019-04-25Merge "Remove explicit dependency on com.couchbase.client/core-io"Yan Yang2-8/+1
2019-04-24Remove explicit dependency on com.couchbase.client/core-ioGuobiao Mo2-8/+1
let org.springframework.data/spring-data-couchbase take care of Couchbase dependencies. Issue-ID: DCAEGEN2-1309 Change-Id: I0e6ba6198bb30a5cc69bdc6202f23df6c8c46e85 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-25Merge "Unit test code for datalake seed code"Yan Yang2-0/+85
2019-04-243 data mappings for ESGuobiao Mo4-5/+69
Issue-ID: DCAEGEN2-1329 Change-Id: I6100362ad58b6e0eae7f86decca4a4dfc9db6102 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-24Unit test code for datalake seed codeRama-Huawei2-0/+85
Increased the code coverage to 100% for domain controller module Issue-ID: DCAEGEN2-1309 Change-Id: Ie0d737323928c6350e8d41ada2eb3880975a93bc Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-23Move hard-coded strings to app configurationGuobiao Mo15-66/+121
Issue-ID: DCAEGEN2-1452 Change-Id: I6577ba3b5a8f877bbaa13d0c590d6a2072331136 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-23Merge "Add REST API calls for DB manipulation."Yan Yang9-70/+288
2019-04-23Add REST API calls for DB manipulation.Kate Hsuan9-70/+288
1. Add the REST APIs for DB configuration. 2. Fix ORM relationship. Issue-ID: DCAEGEN2-1437 Change-Id: Iae842921aa671419e57f569093ecdd74dea4f8d2 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-04-22Unit test code for datalake seed codeRama-Huawei1-1/+1
The package name is corrected Issue-ID: DCAEGEN2-1309 Change-Id: Ib100bc60197f71d4f97a0906aa88200a97c3c748 Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-22Unit test code for datalake seed codeRama-Huawei1-0/+140
Improved Couchbase service code coverage Issue-ID: DCAEGEN2-1309 Change-Id: I1bacbcb3e5c4919a36b02aac68e069c86e04bd02 Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-22Added couchbase mock and client dependenciesRama-Huawei1-178/+189
Dependencies are added for improving datalake service code coverage Issue-ID: DCAEGEN2-1309 Change-Id: I64d2f004137733d082539df76a888ae235e5524f Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-17Unit test to improve sonar coverageGuobiao Mo15-50/+284
Issue-ID: DCAEGEN2-1309 Change-Id: Ia3651bb105d92013d6d2a9d60fffe3b6066adf64 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-16Unit test code for datalake seed codeRama-Huawei1-0/+33
Improved Application code coverage Issue-ID: DCAEGEN2-1309 Change-Id: Iad599877616ea3b633765cf5119a97ef86912a97 Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-16Unit test code for datalake seed codeRama-Huawei6-144/+1140
Fixed the folder related path for generating and reading files from correct folder Issue-ID: DCAEGEN2-1309 Change-Id: I1ec3aae549f484e667eb4048c1ab59b6a60aaf87 Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-15Unit test code for datalake seed codeRama-Huawei1-28/+32
Improved Util module code coverage Issue-ID: DCAEGEN2-1309 Change-Id: Ia962c32a284f0b372f17a0e79da4ae1fe6a4b573 Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-15Merge "Unit test code for datalake seed code"Yan Yang1-35/+31
2019-04-15Unit test code for datalake seed codeRama-Huawei1-35/+31
Increased the config module code coverage to 100% Issue-ID: DCAEGEN2-1309 Change-Id: Ie42be837689685bf5f1023866f7552a62f3e58a9 Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-15Fix Mongo connection methodKate Hsuan1-5/+26
Address and credential must be a list. Issue-ID: DCAEGEN2-1411 Change-Id: I5705d4086476ea02d9eb54c0cf4c329c1848f5cf Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-04-15Merge "Introduce global SSL flag"Yan Yang4-10/+26