summaryrefslogtreecommitdiffstats
path: root/build
AgeCommit message (Collapse)AuthorFilesLines
2020-11-16Fix race condition while creating dest dir for docker imagesBartek Grzybowski1-2/+1
Docker_downloader module uses threads to concurrently save docker images to dest dir which creation is not guarded with any kind of thread lock object thus it could fail on os.makedirs as other thread could have already created that dir. Hence "exist_ok=True" opt is added to os.makedirs call so that it does not fail in such circumstances. Change-Id: I6e2d2c9864b71d038e7b2ed3018cdd3c01916956 Issue-ID: OOM-2631 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-12Upgrade nfs-utils package versionBartek Grzybowski1-1/+1
Change-Id: Ie824d8be21269b3c1ba233c6450ddab617f0159e Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-12Abort if helm process failed to spawnBartek Grzybowski1-0/+10
Change-Id: I930d3ca4c3d9ab49286a38c0ea298abe807ac781 Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-12Add feature to set custom helm repository server portBartek Grzybowski1-6/+46
Change-Id: Ia273290ce661c2e4887e16a3a323a7349c609546 Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-04Override oom-cert-service docker container nameBartek Grzybowski1-2/+6
Container name for certificate generation tool is hardcoded as "generate-certs" hence multiple builds couldn't run in parallel. This change overrides DOCKER_CONTAINER oom-cert-service makefile variable changing the container name effectively. Change-Id: I397ab7f3b04d35070cfb492ca482521ee10159fa Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-04Setup temporary helm repositoryBartek Grzybowski1-13/+23
A temporary helm repository will be created for the process of preparing data list and removed afterwards. This allows setting a separate working helm repo not affecting system wide configuration. Change-Id: I775e28b7c5f0e9b5259588032346ff392f1b1803 Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-04Merge "Update package versions"Bartek Grzybowski1-3/+2
2020-10-30Update package versionsBartek Grzybowski1-3/+2
Drop packages that are downloaded as dependencies of others anyway Dependencies of container-selinux: --> Processing Dependency: policycoreutils-python for package: 2:container-selinux-2.119.2-1.911c772.el7_8.noarch --> Processing Dependency: audit-libs-python >= 2.1.3-4 for package: policycoreutils-python-2.5-34.el7.x86_64 --> Processing Dependency: checkpolicy for package: policycoreutils-python-2.5-34.el7.x86_64 Dependencies of nfs-utils: --> Processing Dependency: gssproxy >= 0.7.0-3 for package: 1:nfs-utils-1.3.0-0.66.el7_8.x86_64 Change-Id: Ia67399685af0205474fa21fbc1fe3ec7eea261bb Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-30Fail the entrypoint script on any command failureBartek Grzybowski1-1/+2
Most importantly this will allowing propagating the failure to the wrapper script. Change-Id: I3f419f588e0f0fb5b459fa1d8e8d520b9f5c78d5 Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-30Clean target repository dir prior to downloading packagesBartek Grzybowski1-0/+3
This increases idempotency and allows avoiding side effects in cases where repo dir already contains images that are not on the list of required packages. Change-Id: Ieaa4e407ae7aacdc8d25440d90860cb880df09e2 Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-30Run docker container in foregroundBartek Grzybowski1-4/+2
This equals current behaviour of running in background and then attaching running container to print logs but will allow wrapper script to inherit exit code from entrypoint script. Change-Id: Ida447ef8024995de6cad81aa2dc857aec36e0d04 Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-28Support setting custom Docker container name suffixBartek Grzybowski1-9/+14
Change-Id: Ic3e4553442efd4c565c834a80184ff78e978cdba Issue-ID: OOM-2612 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-28Drop docker container cleanup statementBartek Grzybowski1-4/+0
Container is run with "--rm" option hence manual cleanup is not needed in any case. Change-Id: Iafe8287b8486abcd4a44fec102db8bfb89af1b63 Issue-ID: OOM-2612 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-28Fix English in comments; fix script synopsis textBartek Grzybowski2-63/+59
Change-Id: I6a67a8e675bdde8d9febc3edf8205c7516d979b8 Issue-ID: OOM-2612 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Use temporary Docker client configBartek Grzybowski1-14/+8
Change-Id: I2c864cbd553e377aa594badf4df58206e40e5794 Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Support publishing exposed container ports on custom host portsBartek Grzybowski1-3/+13
Change-Id: I3dcd47932821a124906f8d125697ecbe21c259af Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Drop registry hosts simulationBartek Grzybowski1-27/+7
Instead of simulating all images original registry hostnames locally running Nexus instance IP address is used to simplify the whole procedre. Change-Id: I42de7e2bc177a9b784090aece0b4ebe7d57912e7 Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Drop exposing additional portsBartek Grzybowski1-17/+0
As the default registry is the only one being set it's no more required to publish ports for each registry listed in images list file. Change-Id: I55a5e1f527bbc98dd4c1e1835c4218dc0fad4c1a Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Push all images to simulated Docker registry onlyBartek Grzybowski1-15/+15
In previous implementation all images were pushed to their original registries which were simulated locally. This change retags all images to locally simulated docker registry only and pushes them there accordingly. Created temporary tag is dropped at the end for order. Change-Id: If1b6633fdcc13d47c6e2b26792980320dce7f49a Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Support setting custom Nexus container nameBartek Grzybowski1-5/+21
Change-Id: I41098413b96ac08fe479167aa0f5d0c4a699ef33 Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-21Bump the nfs-utils package versionBartek Grzybowski1-1/+1
Previous version was no longer available in repository Change-Id: I5bf1048c6ef6438b4cd50ad4231132da2f67432e Issue-ID: OOM-2604 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-16Set SKIP_LINT=true prior to building helm repositoryBartek Grzybowski1-0/+1
SKIP_LINT was already configured to be set in deployment stage in change 0d90cf8fe895e62b7343088ca9a017eff32e92dd but was missed to be set in build script. Change-Id: I599882eaa2e509fda6a41ca5bf5ff77a275adf93 Issue-ID: OOM-2599 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-09Ignore error if helm stable repo is already removedBartek Grzybowski1-1/+1
Fixes e941ec1 Change-Id: I8b5cb6a81998e32204d49c0f2630e1097f830aee Issue-ID: OOM-2591 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-08Remove helm "stable" repo while building chartsBartek Grzybowski1-0/+1
"Stable" repo is removed on targed deployment by a relevant ansible task, it should be removed in build stage as well. Change-Id: Ia89435e73c547e7d1cc4de19d635173307d083f4 Issue-ID: OOM-2591 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-09-24Create directory for output list file if it doesn't existBartek Grzybowski1-0/+5
Should the output list file directory passed as second param not exist the script would fail. Change-Id: I4586df54b42eba2ace49f6aaf03b68042354b44a Issue-ID: OOM-2578 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-09-23Workaround random application_dir removal failureBartek Grzybowski1-1/+1
In cases where --output-dir is set to a directory on a NFS share shutil fails to remove the application_dir. This WO will silence errors from rmtree routine. Change-Id: I0c5d06982f0ba2eb5b15276890b474afc46894e0 Issue-ID: OOM-2577 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-09-17Add feature to install shell autocompletion for kubectlBartek Grzybowski2-0/+2
Change-Id: I732dcd92144f9a8489a351047ab88b53ca36759e Issue-ID: OOM-2564 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-09-08Fix repository directory nameBartek Grzybowski1-1/+1
This fixes a regression bug introduced in 5907acf due to not all 'rhel' path elements updated. Change-Id: I21a7448aa4605f705cfb7a75030d69a0db04319f Issue-ID: OOM-2150 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-09-02Adding missing rpm packagesTomáš Levora1-0/+2
If target OS is installed from RHEL 7.6 DVD ISO, there are missing additional packages added by to the list by this patch. Issue-ID: OOM-2549 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com> Change-Id: I00c8fb3e8e6fb0f1a3879bd66a5c5e2542d321d3
2020-07-30Add automatic virtualenv provisioner for download and package scriptBartek Grzybowski2-0/+14
Change-Id: I072d514c7c2f03991caf6714dbdc0d2d7e5c8bb9 Issue-ID: INT-1670 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-07-29Fix linting issues in Python scriptsBartek Grzybowski4-4/+2
Change-Id: I198340670f808d42aa6fb16de573db4a65005985 Issue-ID: INT-1667 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-05-28Updating RKE version to Frankfurt6.0.0-ONAPTomáš Levora2-5/+6
Updating RKE to v1.0.4 for Kubernetes 1.15.9 Issue-ID: OOM-2403 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com> Change-Id: I87c3f9f4800aa40f62d7569b4ecf3fa373a16796
2020-05-21Updating helm for FrankfurtTomáš Levora2-2/+2
Updaing helm to v2.16.6 as required by OOM Frankfurt Issue-ID: OOM-2363 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com> Change-Id: Ibcf47c26dadc359cb86e039d802ff6afbef7efbd
2020-05-21Merge "Updating kubectl for Frankurt"Tomáš Levora1-1/+1
2020-05-14Fix: docker-images-collector.sh collect empty image name in output list. ↵Mateusz Pilat1-1/+1
Adding also masterPassword param for helm templating The root cause is that not all parameters are present in aaf chart. It is an issue not only for image params, however other cases are not impacting us. Issue-ID: OOM-2405 Signed-off-by: Mateusz Pilat <m.pilat@partner.samsung.com> Change-Id: I1ad1d33717488a82a2ce1eebe524ee41e1264d40
2020-05-14Updating kubectl for FrankurtTomáš Levora1-1/+1
Updating kubectl to v1.15.11 as required for Frankfurt Issue-ID: OOM-2404 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com> Change-Id: I4165271fea9b8024e68f9d395f257e858bd605d7
2020-05-04Adding docker images collector requirementTomáš Levora1-0/+1
Adding pyyaml to requirements as it's required by docker-images-collector.sh Issue-ID: OOM-2393 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com> Change-Id: I52036a8f905fa50eecaddee062d73a38ad2ed9ca
2020-04-30Adding git package as additional oneOndřej Šmalec1-0/+1
Adding git package into additional_packages.list It is needed to download additional stuff using git on infra server. Issue-ID: OOM-2338 Signed-off-by: Ondřej Šmalec <o.smalec@partner.samsung.com> Change-Id: Ibc7708de697bfd5d2318d9ef30d4d556e20b0798
2020-04-30Adding support for another packages listsJan Benedikt2-29/+109
Adding support for another packages lists in create_repo script. Additional package lists is for packages which are for example helpful tools for debugging. Issue-ID: OOM-2340 Signed-off-by: Jan Benedikt <j.benedikt@partner.samsung.com> Change-Id: If0bcb437809b60d83ed92436adade086314ccfac
2020-04-29Merge "Adding support for Ubuntu in create_repo and docker_entrypoint scripts"Tomáš Levora3-35/+204
2020-04-21Adding support for Ubuntu in create_repo and docker_entrypoint scriptsJan Benedikt3-35/+204
Extend script for creating repository with adding Ubuntu platform support. Issue-ID: OOM-1671 Change-Id: I6b1c63cda18e53277fc2aad6dfa3eceefc9a0023 Signed-off-by: Jan Benedikt <j.benedikt@partner.samsung.com>
2020-04-09Remove python 2 dependencyTomáš Levora1-4/+2
Removing python 2 dependency from docker-image-collector.sh Issue-ID: OOM-2359 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com> Change-Id: I6aa4d27cdb10e93981e3dacfb16b2d02a0bf0762
2020-03-31Upgrading package.py requirementsTomáš Levora1-1/+1
Upgrading gitpython from 2.11.1 to 3.1.0 because of incompatiblity with actual version of gitdb2 (4.0.2) Issue-ID: OOM-2344 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com> Change-Id: Ibde20ee7f842858cb26f3ed4b45cb0339093a59f
2020-02-14Fix packaging script - Memory error in md5 calculationsMateusz Pilat1-3/+5
During package preparation whole file is read and stashed in to RAM. when the file is large, like ONAP package it will result in an error Signed-off-by: Mateusz Pilat <m.pilat@partner.samsung.com> Issue-ID: OOM-2308 Change-Id: Ic2dbea4018162bd4cfb380f6fb34078062c38a09
2020-02-13Adding checksum of packages into package.infoOndřej Šmalec1-5/+42
Function to add checksum of created packges to package.info Modified --add-metadata parameter to handle more parameters in format key=value Issue-ID: OOM-2288 Signed-off-by: Ondřej Šmalec <o.smalec@partner.samsung.com> Change-Id: I29114c4566fdfd9643ab5c60951ee65f5680d2fe
2020-01-30Removed version from package nameOndřej Šmalec1-6/+3
Version is kept in package.info file. No need to have it as well in package name. package.info file is present in each tar package. Issue-ID: OOM-2277 Signed-off-by: Ondřej Šmalec <o.smalec@partner.samsung.com> Change-Id: I19fd80cb18e5eac614ac743af954f049536deb3b
2020-01-22Option for additional metadata in package.pyOndřej Šmalec1-4/+13
Issue-ID: OOM-2269 Signed-off-by: Ondřej Šmalec <o.smalec@partner.samsung.com> Change-Id: I6b23512746171fdeaac3883fb61695db2c48c3ab
2019-12-16Merge "Add screen and jq to onap_rpm.list"Tomáš Levora1-0/+2
2019-12-16Add screen and jq to onap_rpm.listJan Benedikt1-0/+2
Added screen and jq packages to RPM repository list. These packages was added as helpful tools for debugging. Oniguruma package is dependency for jq package. Issue-ID: OOM-2200 Change-Id: I2bbd8bf75569156e845341a9766214b03401ec35 Signed-off-by: Jan Benedikt <j.benedikt@partner.samsung.com>
2019-11-28Merge "docker-images-collector.sh to use override values.yaml"Samuli Silvius1-2/+2