summaryrefslogtreecommitdiffstats
path: root/build/download
AgeCommit message (Collapse)AuthorFilesLines
2020-11-16Fix race condition while creating dest dir for docker imagesBartek Grzybowski1-2/+1
Docker_downloader module uses threads to concurrently save docker images to dest dir which creation is not guarded with any kind of thread lock object thus it could fail on os.makedirs as other thread could have already created that dir. Hence "exist_ok=True" opt is added to os.makedirs call so that it does not fail in such circumstances. Change-Id: I6e2d2c9864b71d038e7b2ed3018cdd3c01916956 Issue-ID: OOM-2631 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-07-30Add automatic virtualenv provisioner for download and package scriptBartek Grzybowski1-0/+7
Change-Id: I072d514c7c2f03991caf6714dbdc0d2d7e5c8bb9 Issue-ID: INT-1670 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-07-29Fix linting issues in Python scriptsBartek Grzybowski4-4/+2
Change-Id: I198340670f808d42aa6fb16de573db4a65005985 Issue-ID: INT-1667 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2019-11-25Downloading docker images does not work on WindowsSamuli Silvius1-1/+1
Changing build/download/docker_downloader.py to connect docker engine in more default way i.e. taking engine parameters from environment fixes this script. Issue-ID: OOM-2223 Signed-off-by: Samuli Silvius <s.silvius@partner.samsung.com> Change-Id: Iddf69593bb4cf4596e713c8d537a90424c5925ef
2019-07-11Fix build guide/script regarding python versioningBartek Grzybowski1-1/+1
Specify minimal docker release in build/requirements.txt and build/download/requirements.txt, not a fixed one. Change interpreter for build/package.py as it's Python 3 compliant. Change-Id: I4352aa957371ce85bdea021101ed2f5994f9eedb Issue-ID: OOM-1979 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2019-07-09Fix wrong shebang in download scriptsMilan Verespej11-12/+7
Download does not support python2 so shebang could cause problem. This commit fixes that or removes shebang where not necessary. Issue-ID: OOM-1964 Change-Id: I443f5ef61b9bddfddba66d858d8f65c5ceacd90a Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-07-04Add docker local registry cleaning scriptMilan Verespej2-2/+73
Since with changing data lists there are unused images left in local registry on build server this commit adds script that handles that. Issue-ID: OOM-1952 Change-Id: Ied7a8b09aacd33ef17f0676cfab333d1df8a1a81 Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-06-20Refactor download.py and remove not used filesMilan Verespej9-985/+130
Final commit in download refactoring series. Issue-ID: OOM-1803 Change-Id: I5b71908903ef131b8c16d08225c4d2e2de655130 Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-06-18Refactor of rpm downloadingMilan Verespej1-0/+130
Issue-ID: OOM-1803 Change-Id: Ic1efb371409daddd5910e067ad1f0a85cc7db4ab Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-06-18Refactor pypi packages downloadMilan Verespej1-0/+101
Issue-ID: OOM-1803 Change-Id: I65056208ed3e89777c3511650f8a5aab7396043b Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-06-18Refactor and improve git repository cloningMilan Verespej2-0/+196
Issue-ID: OOM-1803 Change-Id: Ia8e222c2b70b58ed1f7dbc4254ea2f5cb5a9ef7b Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-06-18Refactor and improve docker image downloadingMilan Verespej2-1/+246
Issue-ID: OOM-1803 Change-Id: I4e648d49835faa60165725d1ca4ec22ba1e3e12b Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-06-18Refactor npm packages downloadMilan Verespej2-2/+136
Series of commits to improve python download scripts. Issue-ID: OOM-1803 Change-Id: I199660ab121038780c34065f78538bb4e7b07eb5 Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-06-18Refactor http files downloadMilan Verespej4-0/+396
Original download scripts got out of hand. This series of commits improves style of code (code duplicates, etc.) Issue-ID: OOM-1803 Change-Id: I7b82c1711d27fe450430fbe6d962a450301b0be0 Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-06-14Merge "Add directory remove on failed cloning"Petr Ospalý1-2/+5
2019-06-14Add data list for bin utilsMilan Verespej1-60/+0
Since bin utils can be downloaded as simple http file this script remove previous shell script and changes documentation to add necessary steps. Issue-ID: OOM-1803 Change-Id: I4ced011ce47302349f9e7db74d0ef7f0fe9c4fa0 Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-06-12Add pypi packages downloading python scriptMilan Verespej3-49/+104
Issue-ID: OOM-1803 Change-Id: I5470bad5ad862362976b56350c931929ee4b69d6 Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-06-05Add directory remove on failed cloningMilan Verespej1-2/+5
While downloading git repositories there was no removing of created destination directory which could led to false detection of downloaded repository. This script adds directory remove in such case plus fixes some minor typos in logging and help strings. Issue-ID: OOM-1803 Change-Id: Iec672bc8248e7b2daee06717985e11f7e05aa5be Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-06-05Wrapping-up download refactorisationMichal Ptacek2-0/+108
This commit is making required adaptations mainly in BuildGuide and removing deprecated old version of download scripts. Change-Id: I6421b55d116831dc3b47c7630e91d361d56414c8 Issue-ID: OOM-1803 Signed-off-by: Michal Ptacek <m.ptacek@partner.samsung.com>
2019-06-04Add base download scriptMilan Verespej7-36/+199
This script is supposed to be used for convenience when downloading data from multiple lists at once. Issue-ID: OOM-1803 Change-Id: I4031ed3650f7880883e299b43c79e6bfd08c886c Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-05-24Improve download of npm packagesMilan Verespej1-0/+121
Issue-ID: OOM-1803 Change-Id: I332d7ef6ad628a08b5c9279d65b9d7286f06ee97 Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-05-24Improve download of http filesMilan Verespej2-1/+160
Issue-ID: OOM-1803 Change-Id: If2aeb1aa4fab27641511a6300832ccd7be95e846 Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-05-24Improve download of rpmMilan Verespej1-0/+66
Issue-ID: OOM-1803 Change-Id: I8a6df03a5ede68968e9ccdf8d4de3f9f17d91963 Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-05-24Improve download of git repositoriesMilan Verespej2-0/+96
Issue-ID: OOM-1803 Change-Id: I167f66f3cb6b96d9e21c5ffbd0cf0eb33ef4932e Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-05-24Improve docker image download scriptMilan Verespej4-0/+378
This is part of the series of changes that will improve download scripts. Issue-ID: OOM-1803 Change-Id: I6606762f8e05c25132257e5612997418a9d6d701 Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>