summaryrefslogtreecommitdiffstats
path: root/components/datalake-handler/feeder
AgeCommit message (Collapse)AuthorFilesLines
2019-06-25topic portal portaldesignZhangZihao5-21/+7
Change-Id: I47fd9bdbdedb70ae719790cf24f75a6029faa6c4 Issue-ID: DCAEGEN2-1623 Signed-off-by: ZhangZihao <zhangzihao@chinamobile.com>
2019-06-24Merge "portaldesign and httpclientutil"Yan Yang4-57/+144
2019-06-24portaldesign and httpclientutilZhangZihao6-59/+150
Change-Id: Ib31248a8eee2fe1511472c127abb52a0875c5b21 Issue-ID: DCAEGEN2-1625 Signed-off-by: ZhangZihao <zhangzihao@chinamobile.com>
2019-06-24Merge "db modify 2"Yan Yang2-92/+0
2019-06-24Merge "db modify"Yan Yang4-54/+139
2019-06-24db modify 2ZhangZihao2-92/+0
Change-Id: I32cc643bf9c86d78edc0bc6bf8a7e94fb1721735 Issue-ID: DCAEGEN2-1622 Signed-off-by: ZhangZihao <zhangzihao@chinamobile.com>
2019-06-24portalDesign improveZhangZihao2-2/+6
Change-Id: I1fefccc3bc4fcc72a85a84b46b5cbcb205cf122c Issue-ID: DCAEGEN2-1625 Signed-off-by: ZhangZihao <zhangzihao@chinamobile.com>
2019-06-24designTypeZhangZihao5-19/+74
Change-Id: I8bcbac4a6e1a1f2779a3243615c742719d29f8e5 Issue-ID: DCAEGEN2-1625 Signed-off-by: ZhangZihao <zhangzihao@chinamobile.com>
2019-06-24db modifyZhangZihao4-54/+139
Change-Id: I848b9ac6d45dc60e93be27306cfbed97c73da51d Issue-ID: DCAEGEN2-1622 Signed-off-by: ZhangZihao <zhangzihao@chinamobile.com>
2019-06-21Check Db enabled flagGuobiao Mo5-9/+31
If DB is disabled, don't send data Issue-ID: DCAEGEN2-1622 Change-Id: I24482259125853d28a9abed2b6e987c169411411 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-06-21No data is lost when program is killedGuobiao Mo14-36/+117
When the program is killed by unix 'kill' or crtl+c, program should exits gracefully after all data is saved to DBs. Issue-ID: DCAEGEN2-1633 Change-Id: Ic134440be507faa44d04434eeaea1035ce7d63f0 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-06-19Connect to secured KafkaGuobiao Mo4-10/+21
Issue-ID: DCAEGEN2-1632 Change-Id: I85767916fbf3b8f874ac367b7161b50a272d8595 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-06-18Add a column to table design_typeGuobiao Mo2-5/+9
Issue-ID: DCAEGEN2-1625 Change-Id: I9f5421f083957219336fec0478571014d26c819f Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-06-14Unit test 3ZhangZihao3-0/+376
Change-Id: I63afd2b6c70fb2ce0a182fcb988a579f42c9b23d Issue-ID: DCAEGEN2-1468 Signed-off-by: ZhangZihao <zhangzihao@chinamobile.com>
2019-06-11Merge "Unit test for JsonUtil"Yan Yang1-0/+62
2019-06-11Unit test for JsonUtilGuobiao Mo1-0/+62
Issue-ID: DCAEGEN2-1598 Change-Id: I61ccf5a2859fe80351ea6bf31138b775fe68bead Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-06-11Unit test 1ZhangZihao5-0/+254
Change-Id: I44ad9a41a35a056a9b8bc9d6c760acb5e5413b80 Issue-ID: DCAEGEN2-1468 Signed-off-by: ZhangZihao <zhangzihao@chinamobile.com>
2019-06-10Druid Kafka Indexing Service Supervisor Spec for topicGuobiao Mo6-204/+1813
HW and EPC Issue-ID: DCAEGEN2-1598 Change-Id: Iee4a3a3efc2aa04afb1ab234070cd393ca110055 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-06-06Merge "Dashboard and esTemplate"Yan Yang18-0/+1169
2019-06-06Dashboard and esTemplateZhangZihao18-0/+1169
Change-Id: Id87cb7846ac50ab5e0deee9582479c41aa4e5484 Issue-ID: DCAEGEN2-1329 Signed-off-by: ZhangZihao <zhangzihao@chinamobile.com>
2019-06-04Flatten and Aggregate features in JSON array processingGuobiao Mo14-18/+296
Issue-ID: DCAEGEN2-1598 Change-Id: I9f563bcfa18285daf7b48878e8427bfdb1aff21f Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-05-30Unit tests to improve sonar coverageGuobiao Mo11-106/+499
Issue-ID: DCAEGEN2-1468 Change-Id: Ie322142a2298ca55d32d64861e71ebc64cd8c09e Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-05-28DB schema updateGuobiao Mo1-11/+24
Since the terms 'dashboard' and 'template' are used in some dashboard_template entries. Rename: dashboard -> portal dashboard_type -> design_type dashboard_template -> portal_design Issue-ID: DCAEGEN2-1329 Change-Id: Icaa0874ce652cf95f3989712a23412db362b8db5 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-05-26Dynamically detect topic updates and new topicsGuobiao Mo17-188/+405
Issue-ID: DCAEGEN2-1195 Change-Id: I35d36a9aafe3a7681a9d4745bc509aded111b29d Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-05-22Bug fixKate Hsuan5-18/+36
1. Fix feeder start/stop exceptions- "The Kafka consumer is NOT thread-safe" exception. 2. Modify REST format for feeder start/stop/status. Issue-ID: DCAEGEN2-1437 Change-Id: I7f79243a0098e6fa17b06866ef6dfc3f71b20dc8 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-17Dependency fixKate Hsuan1-1/+1
1. Change spring boot version 2.1.4->2.1.0. 2. Modify URL of list dmaap. Issue-ID: DCAEGEN2-1437 Change-Id: Ieeb28a3cf4c9441d00b6eb278dcb067e391175df Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-16Bug fixKate Hsuan1-0/+1
1. Close zookeeper connection. Issue-ID: DCAEGEN2-1437 Change-Id: I7a2bfdcf14203cbe1708e6148b12ea00c49a07a1 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-14Set HDFS userGuobiao Mo2-3/+5
Use DB.login as HDFS write user. Issue-ID: DCAEGEN2-1498 Change-Id: I59ee83472595b1fc79e9562b68f4178e7fbd920b Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-05-13Support HDFS as a data storeGuobiao Mo19-334/+579
Issue-ID: DCAEGEN2-1498 Change-Id: Id203275bce01bd4a4d6ec131fb9696d78eda82f5 Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-05-10Bug fixKate Hsuan2-2/+3
1. Fix DB config JSON and config format. Issue-ID: DCAEGEN2-1437 Change-Id: I3bf0778c61811cc636099d2dbd118fec49d72625 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-09Bug fixKate Hsuan4-2/+34
1. Add a topic delete API. 2. Fix JSON response body. 3. Fix DB config update. Issue-ID: DCAEGEN2-1437 Change-Id: I4cd5710baf796c8a6bcc9af5283a36bd37659ec8 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-07Merge "Add dashboard template configuration schema"Yan Yang2-0/+41
2019-05-07Add dashboard template configuration schemaKate Hsuan2-0/+41
Issue-ID: DCAEGEN2-1329 Change-Id: I29ef46a44a61ef7adceeabe6b65d406d07902be2 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-05-03Merge "Handle duplicate id"Yan Yang6-103/+116
2019-05-03Merge "Unit test code for datalake seed code"Yan Yang1-0/+2
2019-05-02Handle duplicate idGuobiao Mo6-103/+116
Issue-ID: DCAEGEN2-1411 Change-Id: Ib39b39ff276d7d5c3dbfaa281df6104926fa354d Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-29Use TopicConfig in backend4.0.0-ONAP1.0.0Guobiao Mo19-213/+269
Issue-ID: DCAEGEN2-1200 Change-Id: Ia18993524c272c42ba48485a636f04f94af0cd0a Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-29Modify TopicConfigGuobiao Mo8-72/+80
Issue-ID: DCAEGEN2-1309 Change-Id: Iccfd579f71e0ca971851ba66443973bdd67dcced Signed-off-by: Guobiao Mo <guobiaomo@chinamobile.com>
2019-04-27Merge "unit test of service"Yan Yang4-0/+341
2019-04-27Merge "Unit test code for datalake seed code"Yan Yang2-25/+141
2019-04-26Add Topic configuration APIKate Hsuan9-183/+267
1. Add Topic configuration APIs 2. Remove the "default_topic" DB relationship 3. Fix unit test Issue-ID: DCAEGEN2-1437 Change-Id: I7f992a2439606a1e35dc015e0296ca86375caa87 Signed-off-by: Kate Hsuan <kate.hsuan@qct.io>
2019-04-26Unit test code for datalake seed codeRama-Huawei1-0/+2
Improved Application Configuration code coverage to 100% Issue-ID: DCAEGEN2-1309 Change-Id: Ic42de3b39ba8468fa0c0749700a852ec0162e52b Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-26Unit test code for datalake seed codeRama-Huawei2-25/+141
Improved Feeder Controller code coverage to 100% Added null check for if no consumer records avaliable then no need to process further Issue-ID: DCAEGEN2-1309 Change-Id: Ib3eac572f1a008f9e3c958a483ce3bc1e313a904 Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-26unit test of serviceZhangZihao4-0/+341
Change-Id: Ie6a7838e242d96543c95f101e06e1b8c9e8d0099 Issue-ID: DCAEGEN2-1309 Signed-off-by: ZhangZihao <zhangzihao@chinamobile.com>
2019-04-26Merge "Unit test code for datalake seed code"Yan Yang1-0/+187
2019-04-26Merge "‘correlateClearedMessage’"Yan Yang4-17/+102
2019-04-25Unit test code for datalake seed codeRama-Huawei1-0/+187
Improved Topic Controller code coverage to 100% Issue-ID: DCAEGEN2-1309 Change-Id: I5abec6336c21c5dc664aaa2eba362ef900658576 Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-25Unit test code for datalake seed codeRama-Huawei1-0/+187
Improved DbController code coverage to 100% Issue-ID: DCAEGEN2-1309 Change-Id: I21e60fb4b02a44856a852bc6cba3f0d0d61680d2 Signed-off-by: Rama-Huawei <rama.subba.reddy.s@huawei.com>
2019-04-25‘correlateClearedMessage’ZhangZihao4-17/+102
Change-Id: I32ea4043d32f29c920b370de3c84341c218ed5c2 Issue-ID: DCAEGEN2-1190 Signed-off-by: ZhangZihao <zhangzihao@chinamobile.com>
2019-04-25Merge "Remove explicit dependency on com.couchbase.client/core-io"Yan Yang2-8/+1