aboutsummaryrefslogtreecommitdiffstats
path: root/datafile-app-server
AgeCommit message (Collapse)AuthorFilesLines
2019-03-29Change file name sent to DataRouterelinuxhenrik6-30/+16
In the previous commit for this issue, the file name sent to DataRouter was changed. This turned out to be wrong, so in this commit it is changed back again. Change-Id: I9b0d726f406758846fd256626e73edf59d710c8b Issue-ID: DCAEGEN2-1256 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2019-03-28Merge "Fix DataFile - Align Dmaap Topic configuration"Vijay Venkatesh Kumar6-471/+8
2019-03-22Local filename updated, stability issuesPatrikBuhr18-254/+205
The local filename is changed so it contains PNF name instead of the PNF IP address. The paralellism is restricted to 100 worker threads in order to solve problems with too many open file descriptors and out of memory. Logging is improved. Change-Id: I24ce2e23020cc253a3c7bebac1ab5cf703b5b144 Issue-ID: DCAEGEN2-1118 Signed-off-by: PatrikBuhr <patrik.buhr@est.tech>
2019-03-21Add check to DataRouter if file has been publishedmaximesson16-579/+1124
For each file in the FileReady message that DFC does not know if it has been published yet, it should ask DataRouter if it has been published already to avoid downloading and publishing a file more than once. Change-Id: I18117a6e968ec929aa255052a4c44f890a8ed39d Issue-ID: DCAEGEN2-1256 Signed-off-by: maximesson <maxime.bonneau@est.tech>
2019-03-18Fix DataFile - Align Dmaap Topic configurationYongchaoWu6-471/+8
Remove additional configuration in Blueprints Remove additional configruation in component specs Change-Id: I0d546227af0be485f2ffed27a93c701a7654ff8e Issue-ID: DCAEGEN2-1145 Signed-off-by: YongchaoWu <yongchao.wu@est.tech>
2019-03-18Merge "Thread safety issues"Tony Hansen7-158/+145
2019-03-14DataFile - Align Dmaap Topic configurationYongchaoWu6-57/+594
Blueprints alignment Configbinding service support Modify the policy model complaint to R4 model expected by Policy Change-Id: Ic53f4ab2a5867e5cdf0fc735be180715077154ee Issue-ID: DCAEGEN2-1145 Signed-off-by: YongchaoWu <yongchao.wu@est.tech>
2019-03-14Thread safety issuesPatrikBuhr7-158/+145
The TrustManager is now loaded and initialized once in a thread safe way (instead of each time it is used). Removed some unneeded wrappers. Using AutoCloseable for FTP clients to make sure they are closed in case of exceptions. Made AppConfig thread safe. Change-Id: Ia6a2c8a76bf960013180fdd7c53ae0ff17b26505 Issue-ID: DCAEGEN2-1118 Signed-off-by: PatrikBuhr <patrik.buhr@est.tech>
2019-03-08DFC logging according to ONAP specificationRehanRaza13-119/+214
Change-Id: I6fe18ce3bdbc6d0b1cf5c5e65534cab694cfb898 Issue-ID: DCAEGEN2-1305 Signed-off-by: RehanRaza <muhammad.rehan.raza@est.tech>
2019-03-08Merge "Improvement of the parallelism"Tony Hansen3-67/+379
2019-03-07Change to docker-maven-pluginRehanRaza2-20/+26
Change-Id: I5dc3c5b69b2ef764992e2db76eb9cc154ff5adf7 Issue-ID: DCAEGEN2-1269 Signed-off-by: RehanRaza <muhammad.rehan.raza@est.tech>
2019-03-06Improvement of the parallelismPatrikBuhr3-67/+379
The reactive framework Scedulers uses to few threads. (the same number as the number of processors). That is too few for an io-intense application like this where CPU is not the limiting factor. Change-Id: Ia5f41e75716d309f47dce5f5273b739f7e6d136a Issue-ID: DCAEGEN2-1118 Signed-off-by: PatrikBuhr <patrik.buhr@est.tech>
2019-03-06Fix dockerfile-maven-plugin in pom.xmlRehanRaza1-3/+9
Change-Id: Id0389e1011fdce9dee4fc0d330973ef34bc2ed6a Issue-ID: DCAEGEN2-1269 Signed-off-by: RehanRaza <muhammad.rehan.raza@est.tech>
2019-03-06Merge "DFC DCAE design artifact support"Tony Hansen9-0/+3905
2019-03-05Fix Docker imageRehanRaza2-13/+10
Change-Id: Icf8a37ea63e78d70256571d1bce424e629a04b55 Issue-ID: DCAEGEN2-1269 Signed-off-by: RehanRaza <muhammad.rehan.raza@est.tech>
2019-03-04DFC DCAE design artifact supportYongchaoWu9-0/+3905
Add blueprints, dataformat, component specs, policy and tosca models. Issue-ID: DCAEGEN2-1156 Change-Id: Id1b6573c3cd72a90ab2feca2180ce1d04ecf98c4 Signed-off-by: YongchaoWu <yongchao.wu@est.tech>
2019-02-27Purging of cached informationPatrikBuhr4-18/+154
The datafile collector has a cache will all previously published files. The cache is on regular intevals purged so that non used entries are removed so that it does not grow infinitely. Added a unit test. Change-Id: I8897fee4522c97031f735b1d6774803dcb73926b Issue-ID: DCAEGEN2-1118 Signed-off-by: PatrikBuhr <patrik.buhr@est.tech>
2019-02-27Merge "Fixed some sonar issues"Tony Hansen5-46/+50
2019-02-22Fixed some sonar issuesPatrikBuhr5-46/+50
Changed some Flux to Mono. Removed some obfuscating wrappers. Issue-ID: DCAEGEN2-1118 Change-Id: I76dcaea7c69608cf404389fad93f7539f735aad2 Signed-off-by: PatrikBuhr <patrik.buhr@est.tech>
2019-02-22Run DFC docker container as a non-root userRehanRaza3-27/+54
Change-Id: I82504ebebc8ddf48f6ee6b1c1dfbe433c60ab1aa Issue-ID: DCAEGEN2-1269 Signed-off-by: RehanRaza <muhammad.rehan.raza@est.tech>
2019-02-19Refactor: fix over engineering in ConfigurationYongchaoWu10-433/+153
Remove the duplicated function, move the over engineering code. Make the code simple and understandable. Issue-ID: DCAEGEN2-1222 Change-Id: Iab1737c084421d038b724d2fb41c9d17ebe4dbeb Signed-off-by: YongchaoWu <yongchao.wu@est.tech>
2019-02-15Merge "Add Readme.md"Tony Hansen2-16/+43
2019-02-15Running of file collection in paralellPatrikBuhr27-939/+977
Each FileReady message is run in a separate thread to increase the thoughput. Fetching of files from PNFs is retryed by using the reactive framework. Robustness to temporary failures is increased by retrying to publish fetched files. Fixed so that well known ports (FTPS/SFTP) are used if omitted in the FileReady message URL. Change-Id: I5dfc75a08da0e870fafa3ee1bc83574aca16aabd Issue-ID: DCAEGEN2-1118 Signed-off-by: PatrikBuhr <patrik.buhr@est.tech>
2019-02-13Add Readme.mdyanhuanwang2-16/+43
Format code Change-Id: Iba56718868043d3b19c71892f363fbb838f4988a Signed-off-by: Chengkai Yan <martin.c.yan@est.tech> Issue-ID: DCAEGEN2-1039
2019-01-30Fix for integration with SDKpwielebs6-8/+8
Change-Id: I9947531e2cad813ac8936769147bee710db5a335 Issue-ID: DCAEGEN2-1096 Signed-off-by: pwielebs <piotr.wielebski@nokia.com>
2019-01-25Integration with SDKpwielebs16-140/+264
* New fields added to DmaapPublisherConfiguraion * New fields added to DmaapConsumerConfiguration * Dmaap Consumer web client replaced by SDK's consumer web client * UTs aligned * Disable enforcer plugin in DFC * Update oparent to 1.2.1 Change-Id: I3569180c15227bc2c8df74fd070571b0aa56fa04 Issue-ID: DCAEGEN2-1096 Signed-off-by: pwielebs <piotr.wielebski@nokia.com>
2019-01-08use sdk-cbsmicdzied9-412/+15
Change-Id: I615d57927c163d022683ad3cae2703adda48cf88 Issue-ID: DCAEGEN2-1064 Signed-off-by: micdzied <michal.1.dziedzic@nokia.com>
2018-12-10Merge "Version update 1.1.1"Vijay Venkatesh Kumar1-1/+1
2018-12-10Merge "Make DFC handle multiple messages from MR"Vijay Venkatesh Kumar2-42/+154
2018-12-03Version update 1.1.1maximesson1-1/+1
Change-Id: I6bef1a99747ab2127808bd2ac65372f7537a1441 Issue-ID: DCAEGEN2-1001 Signed-off-by: maximesson <maxime.bonneau@est.tech>
2018-12-03fix bugs in jira DCAEGEN2-940 and DCAEGEN2-941Chengkai Yan2-2/+11
Change-Id: Id0b3e295cab0e085746b034caccbf82aca2e0d7b Signed-off-by: Chengkai Yan <martin.c.yan@est.tech> Issue-ID: DCAEGEN2-940 Issue-ID: DCAEGEN2-941
2018-12-03Make DFC handle multiple messages from MRelinuxhenrik2-42/+154
DMaaP MessageRouter might send multiple messages in the same respons when DFC polls. This was not handled by DFC. Change-Id: I78c2fc7f4512a07fadf61c2cf1f6399d466fc873 Issue-ID: DCAEGEN2-1001 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-11-28Fix sonar issueselinuxhenrik7-206/+205
Change-Id: I4aff14b6afc5faaf95f28286dc6f2f741191e403 Issue-ID: DCAEGEN2-991 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-11-16Update meta-dataChengkai Yan8-190/+636
Add commonEventHeader to X-ATT-DR-META Format code with formatter:off/on Change-Id: I490620af127a03face48bf7b2ad3abf0bb80d4fa Signed-off-by: Chengkai Yan <martin.c.yan@est.tech> Issue-ID: DCAEGEN2-935
2018-11-15Clean up for Sonarelinuxhenrik2-16/+9
Change-Id: I5daa606cd974e43c899b7e35b14d268a255c7102 Issue-ID: DCAEGEN2-835 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-11-15Merge "Add code to validate changeType & changeIdentifier"Vijay Venkatesh Kumar2-29/+92
2018-11-08Update version for DFC 1.1.0Chengkai Yan1-1/+1
Change-Id: I48c0e16c38fef06c0c6455238ba891d84d7efa4c Signed-off-by: Chengkai Yan <martin.c.yan@est.tech> Issue-ID: DCAEGEN2-964
2018-11-06Add cloud config of mutual authentication3.0.0-ONAP1.0.4elinuxhenrik3-19/+28
Change-Id: I8e51c07f750192e1aa03f13c98d3a3a8f0db0f3c Issue-ID: DCAEGEN2-946 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-10-30Add code to validate changeType & changeIdentifierChengkai Yan2-29/+92
Change-Id: Ib6731a7529ebb06588e17f91a986764f042b26b7 Signed-off-by: Chengkai Yan <martin.c.yan@est.tech> Issue-ID: DCAEGEN2-923
2018-10-15Improve setKeyManager & setTrustManagerChengkai Yan4-14/+23
Change-Id: I14b1bd6872e40496ce233ec4974ad9e5fd92d949 Signed-off-by: Chengkai Yan <martin.c.yan@est.tech> Issue-ID: DCAEGEN2-867
2018-10-09Fix retry when file download fails1.0.2elinuxhenrik4-28/+151
When the Datafile collector is unable to download the file from an xNF it now retries to collect the file. Change-Id: I61f68f9cf7af1a7fab160b0e936daafd1a23aaf8 Issue-ID: DCAEGEN2-864 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-10-03Fix mutual authenticationVijay Venkatesh Kumar27-558/+365
Last version from demo. Change-Id: Ib41581bf6f9eb92a03edf8434261d3674b6e3e39 Issue-ID: DCAEGEN2-860 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech> Signed-off-by: Vijay Venkatesh Kumar <vv770d@att.com>
2018-10-02Handle redirect from DataRouter properlyelinuxhenrik7-41/+26
Change-Id: I1eae8b45a2437b97bccedcb0f5cc02ac29f5044f Issue-ID: DCAEGEN2-850 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-09-28Fixing Sonar issuespwielebs3-10/+12
Change-Id: I67360cd501630adad8166c9278e9955c6be7758f Issue-ID: DCAEGEN2-835 Signed-off-by: pwielebs <piotr.wielebski@nokia.com>
2018-09-27Fix delivery to DataRouterelinuxhenrik15-436/+393
The messages to the DataRouter was not actually sent. Change-Id: I5748ee0cc19a5049ca4d965caefb5cdf2204419f Issue-ID: DCAEGEN2-841 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-09-24Merge "Add Http configuration"Vijay Venkatesh Kumar1-0/+46
2018-09-24Merge "Use correct Content Type from DMaaP"Vijay Venkatesh Kumar1-3/+3
2018-09-21Add Http configurationelinuxhenrik1-0/+46
Add Http configuration needed for setting up the Rest server. Change-Id: Id66cd9700e5f0a849a70cb9a91f36385194e8144 Issue-ID: DCAEGEN2-826 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-09-21Use correct Content Type from DMaaPelinuxhenrik1-3/+3
Add the Content Type to the header the DMaaP consumer uses to get the fileReady event from DMAaaP to prevent formatting problems. Change-Id: Iedf38b7542e5709a78f383d31c75e7b95aa56cfe Issue-ID: DCAEGEN2-825 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-09-21Correct URL for DataRouter publicationelinuxhenrik3-28/+28
Make the URL for the DataRouter publication follow the format: https://dmaap-dr-prov:8443/publish/1/<unique identifier> As unique identifier the file name will be used to start with. Change-Id: I8060b8d25484201441654d88a1788d538ad3e002 Issue-ID: DCAEGEN2-824 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>