aboutsummaryrefslogtreecommitdiffstats
path: root/datafile-dmaap-client
AgeCommit message (Collapse)AuthorFilesLines
2019-04-11Housekeepingelinuxhenrik19-1809/+0
No functional changes made in this commit. Removed CheckStyle and Sonar warnings. Formatted code. Renamed methods and classes for better understanding. Removed unnecessary classes. Moved all code to single project. Change-Id: Ie3feb6c6a985e94a382812aa083dcf57bc46c7b3 Issue-ID: DCAEGEN2-1367 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2019-04-04Improved loggingPatrikBuhr4-33/+36
Fixed problem with startup which lead to that the REST API was not working running locally. Fixed problem with DmaapProducerHttpClient which would use no timeout, which can lead to infinitly haninging threads. A long timeout is used instead. Change-Id: I28469b1b3aaad0dab4cf247bb8af968e71a60133 Issue-ID: DCAEGEN2-1305 Signed-off-by: PatrikBuhr <patrik.buhr@est.tech>
2019-03-22Local filename updated, stability issuesPatrikBuhr5-56/+56
The local filename is changed so it contains PNF name instead of the PNF IP address. The paralellism is restricted to 100 worker threads in order to solve problems with too many open file descriptors and out of memory. Logging is improved. Change-Id: I24ce2e23020cc253a3c7bebac1ab5cf703b5b144 Issue-ID: DCAEGEN2-1118 Signed-off-by: PatrikBuhr <patrik.buhr@est.tech>
2019-03-21Add check to DataRouter if file has been publishedmaximesson8-268/+292
For each file in the FileReady message that DFC does not know if it has been published yet, it should ask DataRouter if it has been published already to avoid downloading and publishing a file more than once. Change-Id: I18117a6e968ec929aa255052a4c44f890a8ed39d Issue-ID: DCAEGEN2-1256 Signed-off-by: maximesson <maxime.bonneau@est.tech>
2019-03-14Thread safety issuesPatrikBuhr13-620/+291
The TrustManager is now loaded and initialized once in a thread safe way (instead of each time it is used). Removed some unneeded wrappers. Using AutoCloseable for FTP clients to make sure they are closed in case of exceptions. Made AppConfig thread safe. Change-Id: Ia6a2c8a76bf960013180fdd7c53ae0ff17b26505 Issue-ID: DCAEGEN2-1118 Signed-off-by: PatrikBuhr <patrik.buhr@est.tech>
2019-03-08DFC logging according to ONAP specificationRehanRaza3-16/+33
Change-Id: I6fe18ce3bdbc6d0b1cf5c5e65534cab694cfb898 Issue-ID: DCAEGEN2-1305 Signed-off-by: RehanRaza <muhammad.rehan.raza@est.tech>
2019-02-27Purging of cached informationPatrikBuhr1-7/+3
The datafile collector has a cache will all previously published files. The cache is on regular intevals purged so that non used entries are removed so that it does not grow infinitely. Added a unit test. Change-Id: I8897fee4522c97031f735b1d6774803dcb73926b Issue-ID: DCAEGEN2-1118 Signed-off-by: PatrikBuhr <patrik.buhr@est.tech>
2019-02-22Fixed some sonar issuesPatrikBuhr11-389/+55
Changed some Flux to Mono. Removed some obfuscating wrappers. Issue-ID: DCAEGEN2-1118 Change-Id: I76dcaea7c69608cf404389fad93f7539f735aad2 Signed-off-by: PatrikBuhr <patrik.buhr@est.tech>
2019-02-15Running of file collection in paralellPatrikBuhr26-639/+396
Each FileReady message is run in a separate thread to increase the thoughput. Fetching of files from PNFs is retryed by using the reactive framework. Robustness to temporary failures is increased by retrying to publish fetched files. Fixed so that well known ports (FTPS/SFTP) are used if omitted in the FileReady message URL. Change-Id: I5dfc75a08da0e870fafa3ee1bc83574aca16aabd Issue-ID: DCAEGEN2-1118 Signed-off-by: PatrikBuhr <patrik.buhr@est.tech>
2019-01-31Change ATT Meta Header for generic alternativeegernug2-4/+4
Change-Id: Ie4ba3d8afebf7cda3dc0a841c5c5fa5d4cd95046 Issue-ID: DMAAP-999 Signed-off-by: egernug <gerard.nugent@est.tech>
2019-01-25Integration with SDKpwielebs12-482/+14
* New fields added to DmaapPublisherConfiguraion * New fields added to DmaapConsumerConfiguration * Dmaap Consumer web client replaced by SDK's consumer web client * UTs aligned * Disable enforcer plugin in DFC * Update oparent to 1.2.1 Change-Id: I3569180c15227bc2c8df74fd070571b0aa56fa04 Issue-ID: DCAEGEN2-1096 Signed-off-by: pwielebs <piotr.wielebski@nokia.com>
2018-12-10Merge "Version update 1.1.1"Vijay Venkatesh Kumar1-1/+1
2018-12-03Version update 1.1.1maximesson1-1/+1
Change-Id: I6bef1a99747ab2127808bd2ac65372f7537a1441 Issue-ID: DCAEGEN2-1001 Signed-off-by: maximesson <maxime.bonneau@est.tech>
2018-12-03fix bugs in jira DCAEGEN2-940 and DCAEGEN2-941Chengkai Yan14-369/+308
Change-Id: Id0b3e295cab0e085746b034caccbf82aca2e0d7b Signed-off-by: Chengkai Yan <martin.c.yan@est.tech> Issue-ID: DCAEGEN2-940 Issue-ID: DCAEGEN2-941
2018-11-16Update meta-dataChengkai Yan2-8/+21
Add commonEventHeader to X-ATT-DR-META Format code with formatter:off/on Change-Id: I490620af127a03face48bf7b2ad3abf0bb80d4fa Signed-off-by: Chengkai Yan <martin.c.yan@est.tech> Issue-ID: DCAEGEN2-935
2018-11-15Clean up for Sonarelinuxhenrik26-464/+169
Change-Id: I5daa606cd974e43c899b7e35b14d268a255c7102 Issue-ID: DCAEGEN2-835 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-11-15Merge "Add test for redirect"Vijay Venkatesh Kumar1-0/+33
2018-11-15Merge "add test"Vijay Venkatesh Kumar3-0/+125
2018-11-15Merge "Add test for FtpsClient, Improve code coverage."Vijay Venkatesh Kumar3-1/+80
2018-11-08Update version for DFC 1.1.0Chengkai Yan1-1/+1
Change-Id: I48c0e16c38fef06c0c6455238ba891d84d7efa4c Signed-off-by: Chengkai Yan <martin.c.yan@est.tech> Issue-ID: DCAEGEN2-964
2018-11-06Add cloud config of mutual authentication3.0.0-ONAP1.0.4elinuxhenrik1-1/+1
Change-Id: I8e51c07f750192e1aa03f13c98d3a3a8f0db0f3c Issue-ID: DCAEGEN2-946 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-11-01Add test for FtpsClient, Improve code coverage.Chengkai Yan3-1/+80
Fix a security vulnerability risk Change-Id: I71560dfd9977a7e96ac4441e468602b616c7e7a6 Issue-ID: DCAEGEN2-889 Signed-off-by: Chengkai Yan <martin.c.yan@est.tech>
2018-10-24Add test for redirectelinuxhenrik1-0/+33
Change-Id: Ic8cc9c6ba63267498c24ba05267301a6b499c9dc Issue-ID: DCAEGEN2-835 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-10-24add testmicdzied3-0/+125
Change-Id: I696421423fe0b6d9634bb2ef90829b53ac64a7b0 Issue-ID: DCAEGEN2-889 Signed-off-by: micdzied <michal.1.dziedzic@nokia.com>
2018-10-19Merge "Fixing Sonar issues & Test classes added"1.0.3Vijay Venkatesh Kumar7-0/+135
2018-10-18Fixing Sonar issues & Test classes addedpwielebs7-0/+135
Change-Id: I88ace2333d9f52fcd81eb4d1b883a04dd329c4cc Issue-ID: DCAEGEN2-835 Signed-off-by: pwielebs <piotr.wielebski@nokia.com>
2018-10-15Improve setKeyManager & setTrustManagerChengkai Yan6-6/+34
Change-Id: I14b1bd6872e40496ce233ec4974ad9e5fd92d949 Signed-off-by: Chengkai Yan <martin.c.yan@est.tech> Issue-ID: DCAEGEN2-867
2018-10-09Fix retry when file download fails1.0.2elinuxhenrik9-60/+214
When the Datafile collector is unable to download the file from an xNF it now retries to collect the file. Change-Id: I61f68f9cf7af1a7fab160b0e936daafd1a23aaf8 Issue-ID: DCAEGEN2-864 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-10-03Fix mutual authenticationVijay Venkatesh Kumar27-32/+1620
Last version from demo. Change-Id: Ib41581bf6f9eb92a03edf8434261d3674b6e3e39 Issue-ID: DCAEGEN2-860 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech> Signed-off-by: Vijay Venkatesh Kumar <vv770d@att.com>
2018-10-03Fix bug in DataRouter file bodyelinuxhenrik2-10/+38
Change-Id: Ia3f868c272ebc426b6a694074dbd2a4a2cb7ae32 Issue-ID: DCAEGEN2-850 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-10-02Handle redirect from DataRouter properlyelinuxhenrik10-99/+416
Change-Id: I1eae8b45a2437b97bccedcb0f5cc02ac29f5044f Issue-ID: DCAEGEN2-850 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-09-28Fixing Sonar issuespwielebs1-3/+1
Change-Id: I67360cd501630adad8166c9278e9955c6be7758f Issue-ID: DCAEGEN2-835 Signed-off-by: pwielebs <piotr.wielebski@nokia.com>
2018-09-27Fix delivery to DataRouterelinuxhenrik2-45/+35
The messages to the DataRouter was not actually sent. Change-Id: I5748ee0cc19a5049ca4d965caefb5cdf2204419f Issue-ID: DCAEGEN2-841 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-09-24Merge "Use correct Content Type from DMaaP"Vijay Venkatesh Kumar2-52/+38
2018-09-21Use correct Content Type from DMaaPelinuxhenrik2-52/+38
Add the Content Type to the header the DMaaP consumer uses to get the fileReady event from DMAaaP to prevent formatting problems. Change-Id: Iedf38b7542e5709a78f383d31c75e7b95aa56cfe Issue-ID: DCAEGEN2-825 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-09-21Correct URL for DataRouter publicationelinuxhenrik2-36/+27
Make the URL for the DataRouter publication follow the format: https://dmaap-dr-prov:8443/publish/1/<unique identifier> As unique identifier the file name will be used to start with. Change-Id: I8060b8d25484201441654d88a1788d538ad3e002 Issue-ID: DCAEGEN2-824 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-09-19Merge "Adapt to new VES specification for notifications"Vijay Venkatesh Kumar1-0/+1
2018-09-18Adapt to new VES specification for notificationselinuxhenrik1-0/+1
Change-Id: I0ba8e67714679dc02fb08ce94787b1f98034a6c4 Issue-ID: DCAEGEN2-782 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-09-18Security vulnerabilities correctionswasala1-9/+6
*Improved imported libraries *Fixed imported libraries in connection of risk security Change-Id: I28e6b22f8088f70cae431e6e99936cdb67e4cc0d Issue-ID: DCAEGEN2-764 Signed-off-by: wasala <przemyslaw.wasala@nokia.com>
2018-09-17Deliver first version of Datafileelinuxhenrik15-411/+418
Change-Id: Iadd1455d7fe45b4c022dd7fde2f8a506d1b7cd57 Issue-ID: DCAEGEN2-640 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>
2018-08-20Add seed code.elinuxhenrik12-0/+1029
First version based on PRH micro service. Change-Id: Iea1673a8a1961006b1ea98ef245e213e3652eb82 Issue-ID: DCAEGEN2-638 Signed-off-by: elinuxhenrik <henrik.b.andersson@est.tech>