summaryrefslogtreecommitdiffstats
path: root/build
AgeCommit message (Collapse)AuthorFilesLines
2021-01-21Setup separate script logic for helm v3 handlingBartek Grzybowski1-22/+46
Change-Id: I2c1d5233ff43c2fc2cee104b1438089574935023 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-21Set HELM_VERSION variableBartek Grzybowski1-0/+1
It will be leveraged for different handling of helm v2 and v3 workflow Change-Id: I3d3939ef2ed491e9534b560c24af7e4ba9ed505d Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-21Allow setting custom Helm binary pathBartek Grzybowski1-6/+28
Change-Id: I66e232a8c243df89a1a9b573c592a08c72dc5324 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-18Update download link for Helm v2Bartek Grzybowski1-1/+1
Official helm binaries are hosted on get.helm.sh Change-Id: I4aab0b757f38e904a0bfd7483a92728f4a901a3a Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-12-22Don't refresh repository cache upon initBartek Grzybowski1-1/+1
Main reason for adding this option is that stable repo url of https://kubernetes-charts.storage.googleapis.com has been obsoleted hence the "init" command fails on trying to reach it. Since we're removing it afterwards anyway thus --skip-refresh will allow "init" to pass without actually trying to get it's contents. Change-Id: I0719648fcfaf30da52ae19327f024b901471f188 Issue-ID: OOM-2660 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-25Support "fake" OOM deploymentBartek Grzybowski1-1/+1
"Fake deployment" is an OOM offline deployment mode which allows to enumerate docker images utilized by auxiliary platform deployment tools, which are not used by any real ONAP helm charts, by the means of "helm template". Change-Id: Iaa26281a1e7ef7ac68bb9e9a99521e5791f913b6 Issue-ID: OOM-2639 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-23Enhance repo creation scripts idempotency by supporting cachingBartek Grzybowski2-21/+113
While 'yumdownloader' and 'apt-get download' commands do not re-download packages that are already present in working dir, scripts still need to perform package dependencies resolution which is a time consuming activity hence a feature was added to skip any further actions (download or deps resolution) on packages that are already present locally. For cold versus warm cache the gain in run time is: cold warm RPM 90s 10s DEB 7m 90s Change-Id: Ie502934cff6484844557832251e7ce0991789cfb Issue-ID: OOM-2635 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-20Fix Ubuntu package listBartek Grzybowski1-4/+2
Change-Id: I7d8d83622a3280b7f70b495500855134af1ab7e2 Issue-ID: OOM-2635 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-16Fix race condition while creating dest dir for docker imagesBartek Grzybowski1-2/+1
Docker_downloader module uses threads to concurrently save docker images to dest dir which creation is not guarded with any kind of thread lock object thus it could fail on os.makedirs as other thread could have already created that dir. Hence "exist_ok=True" opt is added to os.makedirs call so that it does not fail in such circumstances. Change-Id: I6e2d2c9864b71d038e7b2ed3018cdd3c01916956 Issue-ID: OOM-2631 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-12Upgrade nfs-utils package versionBartek Grzybowski1-1/+1
Change-Id: Ie824d8be21269b3c1ba233c6450ddab617f0159e Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-12Abort if helm process failed to spawnBartek Grzybowski1-0/+10
Change-Id: I930d3ca4c3d9ab49286a38c0ea298abe807ac781 Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-12Add feature to set custom helm repository server portBartek Grzybowski1-6/+46
Change-Id: Ia273290ce661c2e4887e16a3a323a7349c609546 Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-04Override oom-cert-service docker container nameBartek Grzybowski1-2/+6
Container name for certificate generation tool is hardcoded as "generate-certs" hence multiple builds couldn't run in parallel. This change overrides DOCKER_CONTAINER oom-cert-service makefile variable changing the container name effectively. Change-Id: I397ab7f3b04d35070cfb492ca482521ee10159fa Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-04Setup temporary helm repositoryBartek Grzybowski1-13/+23
A temporary helm repository will be created for the process of preparing data list and removed afterwards. This allows setting a separate working helm repo not affecting system wide configuration. Change-Id: I775e28b7c5f0e9b5259588032346ff392f1b1803 Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-04Merge "Update package versions"Bartek Grzybowski1-3/+2
2020-10-30Update package versionsBartek Grzybowski1-3/+2
Drop packages that are downloaded as dependencies of others anyway Dependencies of container-selinux: --> Processing Dependency: policycoreutils-python for package: 2:container-selinux-2.119.2-1.911c772.el7_8.noarch --> Processing Dependency: audit-libs-python >= 2.1.3-4 for package: policycoreutils-python-2.5-34.el7.x86_64 --> Processing Dependency: checkpolicy for package: policycoreutils-python-2.5-34.el7.x86_64 Dependencies of nfs-utils: --> Processing Dependency: gssproxy >= 0.7.0-3 for package: 1:nfs-utils-1.3.0-0.66.el7_8.x86_64 Change-Id: Ia67399685af0205474fa21fbc1fe3ec7eea261bb Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-30Fail the entrypoint script on any command failureBartek Grzybowski1-1/+2
Most importantly this will allowing propagating the failure to the wrapper script. Change-Id: I3f419f588e0f0fb5b459fa1d8e8d520b9f5c78d5 Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-30Clean target repository dir prior to downloading packagesBartek Grzybowski1-0/+3
This increases idempotency and allows avoiding side effects in cases where repo dir already contains images that are not on the list of required packages. Change-Id: Ieaa4e407ae7aacdc8d25440d90860cb880df09e2 Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-30Run docker container in foregroundBartek Grzybowski1-4/+2
This equals current behaviour of running in background and then attaching running container to print logs but will allow wrapper script to inherit exit code from entrypoint script. Change-Id: Ida447ef8024995de6cad81aa2dc857aec36e0d04 Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-28Support setting custom Docker container name suffixBartek Grzybowski1-9/+14
Change-Id: Ic3e4553442efd4c565c834a80184ff78e978cdba Issue-ID: OOM-2612 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-28Drop docker container cleanup statementBartek Grzybowski1-4/+0
Container is run with "--rm" option hence manual cleanup is not needed in any case. Change-Id: Iafe8287b8486abcd4a44fec102db8bfb89af1b63 Issue-ID: OOM-2612 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-28Fix English in comments; fix script synopsis textBartek Grzybowski2-63/+59
Change-Id: I6a67a8e675bdde8d9febc3edf8205c7516d979b8 Issue-ID: OOM-2612 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Use temporary Docker client configBartek Grzybowski1-14/+8
Change-Id: I2c864cbd553e377aa594badf4df58206e40e5794 Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Support publishing exposed container ports on custom host portsBartek Grzybowski1-3/+13
Change-Id: I3dcd47932821a124906f8d125697ecbe21c259af Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Drop registry hosts simulationBartek Grzybowski1-27/+7
Instead of simulating all images original registry hostnames locally running Nexus instance IP address is used to simplify the whole procedre. Change-Id: I42de7e2bc177a9b784090aece0b4ebe7d57912e7 Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Drop exposing additional portsBartek Grzybowski1-17/+0
As the default registry is the only one being set it's no more required to publish ports for each registry listed in images list file. Change-Id: I55a5e1f527bbc98dd4c1e1835c4218dc0fad4c1a Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Push all images to simulated Docker registry onlyBartek Grzybowski1-15/+15
In previous implementation all images were pushed to their original registries which were simulated locally. This change retags all images to locally simulated docker registry only and pushes them there accordingly. Created temporary tag is dropped at the end for order. Change-Id: If1b6633fdcc13d47c6e2b26792980320dce7f49a Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Support setting custom Nexus container nameBartek Grzybowski1-5/+21
Change-Id: I41098413b96ac08fe479167aa0f5d0c4a699ef33 Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-21Bump the nfs-utils package versionBartek Grzybowski1-1/+1
Previous version was no longer available in repository Change-Id: I5bf1048c6ef6438b4cd50ad4231132da2f67432e Issue-ID: OOM-2604 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-16Set SKIP_LINT=true prior to building helm repositoryBartek Grzybowski1-0/+1
SKIP_LINT was already configured to be set in deployment stage in change 0d90cf8fe895e62b7343088ca9a017eff32e92dd but was missed to be set in build script. Change-Id: I599882eaa2e509fda6a41ca5bf5ff77a275adf93 Issue-ID: OOM-2599 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-09Ignore error if helm stable repo is already removedBartek Grzybowski1-1/+1
Fixes e941ec1 Change-Id: I8b5cb6a81998e32204d49c0f2630e1097f830aee Issue-ID: OOM-2591 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-08Remove helm "stable" repo while building chartsBartek Grzybowski1-0/+1
"Stable" repo is removed on targed deployment by a relevant ansible task, it should be removed in build stage as well. Change-Id: Ia89435e73c547e7d1cc4de19d635173307d083f4 Issue-ID: OOM-2591 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-09-24Create directory for output list file if it doesn't existBartek Grzybowski1-0/+5
Should the output list file directory passed as second param not exist the script would fail. Change-Id: I4586df54b42eba2ace49f6aaf03b68042354b44a Issue-ID: OOM-2578 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-09-23Workaround random application_dir removal failureBartek Grzybowski1-1/+1
In cases where --output-dir is set to a directory on a NFS share shutil fails to remove the application_dir. This WO will silence errors from rmtree routine. Change-Id: I0c5d06982f0ba2eb5b15276890b474afc46894e0 Issue-ID: OOM-2577 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-09-17Add feature to install shell autocompletion for kubectlBartek Grzybowski2-0/+2
Change-Id: I732dcd92144f9a8489a351047ab88b53ca36759e Issue-ID: OOM-2564 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-09-08Fix repository directory nameBartek Grzybowski1-1/+1
This fixes a regression bug introduced in 5907acf due to not all 'rhel' path elements updated. Change-Id: I21a7448aa4605f705cfb7a75030d69a0db04319f Issue-ID: OOM-2150 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-09-02Adding missing rpm packagesTomáš Levora1-0/+2
If target OS is installed from RHEL 7.6 DVD ISO, there are missing additional packages added by to the list by this patch. Issue-ID: OOM-2549 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com> Change-Id: I00c8fb3e8e6fb0f1a3879bd66a5c5e2542d321d3
2020-07-30Add automatic virtualenv provisioner for download and package scriptBartek Grzybowski2-0/+14
Change-Id: I072d514c7c2f03991caf6714dbdc0d2d7e5c8bb9 Issue-ID: INT-1670 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-07-29Fix linting issues in Python scriptsBartek Grzybowski4-4/+2
Change-Id: I198340670f808d42aa6fb16de573db4a65005985 Issue-ID: INT-1667 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-05-28Updating RKE version to Frankfurt6.0.0-ONAPTomáš Levora2-5/+6
Updating RKE to v1.0.4 for Kubernetes 1.15.9 Issue-ID: OOM-2403 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com> Change-Id: I87c3f9f4800aa40f62d7569b4ecf3fa373a16796
2020-05-21Updating helm for FrankfurtTomáš Levora2-2/+2
Updaing helm to v2.16.6 as required by OOM Frankfurt Issue-ID: OOM-2363 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com> Change-Id: Ibcf47c26dadc359cb86e039d802ff6afbef7efbd
2020-05-21Merge "Updating kubectl for Frankurt"Tomáš Levora1-1/+1
2020-05-14Fix: docker-images-collector.sh collect empty image name in output list. ↵Mateusz Pilat1-1/+1
Adding also masterPassword param for helm templating The root cause is that not all parameters are present in aaf chart. It is an issue not only for image params, however other cases are not impacting us. Issue-ID: OOM-2405 Signed-off-by: Mateusz Pilat <m.pilat@partner.samsung.com> Change-Id: I1ad1d33717488a82a2ce1eebe524ee41e1264d40
2020-05-14Updating kubectl for FrankurtTomáš Levora1-1/+1
Updating kubectl to v1.15.11 as required for Frankfurt Issue-ID: OOM-2404 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com> Change-Id: I4165271fea9b8024e68f9d395f257e858bd605d7
2020-05-04Adding docker images collector requirementTomáš Levora1-0/+1
Adding pyyaml to requirements as it's required by docker-images-collector.sh Issue-ID: OOM-2393 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com> Change-Id: I52036a8f905fa50eecaddee062d73a38ad2ed9ca
2020-04-30Adding git package as additional oneOndřej Šmalec1-0/+1
Adding git package into additional_packages.list It is needed to download additional stuff using git on infra server. Issue-ID: OOM-2338 Signed-off-by: Ondřej Šmalec <o.smalec@partner.samsung.com> Change-Id: Ibc7708de697bfd5d2318d9ef30d4d556e20b0798
2020-04-30Adding support for another packages listsJan Benedikt2-29/+109
Adding support for another packages lists in create_repo script. Additional package lists is for packages which are for example helpful tools for debugging. Issue-ID: OOM-2340 Signed-off-by: Jan Benedikt <j.benedikt@partner.samsung.com> Change-Id: If0bcb437809b60d83ed92436adade086314ccfac
2020-04-29Merge "Adding support for Ubuntu in create_repo and docker_entrypoint scripts"Tomáš Levora3-35/+204
2020-04-21Adding support for Ubuntu in create_repo and docker_entrypoint scriptsJan Benedikt3-35/+204
Extend script for creating repository with adding Ubuntu platform support. Issue-ID: OOM-1671 Change-Id: I6b1c63cda18e53277fc2aad6dfa3eceefc9a0023 Signed-off-by: Jan Benedikt <j.benedikt@partner.samsung.com>
2020-04-09Remove python 2 dependencyTomáš Levora1-4/+2
Removing python 2 dependency from docker-image-collector.sh Issue-ID: OOM-2359 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com> Change-Id: I6aa4d27cdb10e93981e3dacfb16b2d02a0bf0762