summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-02-11Merge "Move Helm v2 plugin installation logic into separate playbook"Krzysztof Opasiak5-25/+30
2021-01-26Move Helm v2 plugin installation logic into separate playbookBartek Grzybowski5-25/+30
Change-Id: Icc767450da832d8792b7bdf33f85e5ffc97ee435 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-25Merge "Fix repository bug in nexus_image_add"Bartek Grzybowski1-1/+1
2021-01-21Add support for Helm v3Bartek Grzybowski1-25/+35
This change adds support for extracting docker image list using Helm version 3. Chartmuseum is used to serve the charts. Change-Id: Ib7d7da312c1d9750548dd560d9571eb4715c0fa8 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-21Fix cleanup sequenceBartek Grzybowski1-2/+2
Chart repository process should be killed before removing it's storage Change-Id: Idd53a0cc812ca0d17beb3e0f7264de4280a6b536 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-21Setup separate script logic for helm v3 handlingBartek Grzybowski1-22/+46
Change-Id: I2c1d5233ff43c2fc2cee104b1438089574935023 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-21Set HELM_VERSION variableBartek Grzybowski1-0/+1
It will be leveraged for different handling of helm v2 and v3 workflow Change-Id: I3d3939ef2ed491e9534b560c24af7e4ba9ed505d Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-21Allow setting custom Helm binary pathBartek Grzybowski1-6/+28
Change-Id: I66e232a8c243df89a1a9b573c592a08c72dc5324 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-18Update download link for Helm v2Bartek Grzybowski1-1/+1
Official helm binaries are hosted on get.helm.sh Change-Id: I4aab0b757f38e904a0bfd7483a92728f4a901a3a Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-12-30Support setting custom dns resolverBartek Grzybowski3-0/+8
This change allows setting custom dns resolvers on control node and all k8s hosts. Change-Id: I49db6e5d5d3b5be5082adc73810eb282dce14eed Issue-ID: OOM-2650 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-12-30Support setting custom docker registry mirror in cicdansibleBartek Grzybowski3-1/+20
This facility allows setting custom docker registry mirror on k8s hosts in Docker global config. Change-Id: I01d02bdbabf2bed0b5b55819ae22770dd52de771 Issue-ID: OOM-2650 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-12-22Don't refresh repository cache upon initBartek Grzybowski1-1/+1
Main reason for adding this option is that stable repo url of https://kubernetes-charts.storage.googleapis.com has been obsoleted hence the "init" command fails on trying to reach it. Since we're removing it afterwards anyway thus --skip-refresh will allow "init" to pass without actually trying to get it's contents. Change-Id: I0719648fcfaf30da52ae19327f024b901471f188 Issue-ID: OOM-2660 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-12-17Fix Molecule framework runner setup scriptsBartek Grzybowski1-1/+1
Ansible-lint release has to be set explicitly as the one installed by default breaks the linter execution. Change-Id: Id824fb3f4ae94cf8608736bbebb1809568193050 Issue-ID: OOM-2650 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-25Support "fake" OOM deploymentBartek Grzybowski1-1/+1
"Fake deployment" is an OOM offline deployment mode which allows to enumerate docker images utilized by auxiliary platform deployment tools, which are not used by any real ONAP helm charts, by the means of "helm template". Change-Id: Iaa26281a1e7ef7ac68bb9e9a99521e5791f913b6 Issue-ID: OOM-2639 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-23Enhance repo creation scripts idempotency by supporting cachingBartek Grzybowski2-21/+113
While 'yumdownloader' and 'apt-get download' commands do not re-download packages that are already present in working dir, scripts still need to perform package dependencies resolution which is a time consuming activity hence a feature was added to skip any further actions (download or deps resolution) on packages that are already present locally. For cold versus warm cache the gain in run time is: cold warm RPM 90s 10s DEB 7m 90s Change-Id: Ie502934cff6484844557832251e7ce0991789cfb Issue-ID: OOM-2635 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-20Fix Ubuntu package listBartek Grzybowski1-4/+2
Change-Id: I7d8d83622a3280b7f70b495500855134af1ab7e2 Issue-ID: OOM-2635 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-16Fix race condition while creating dest dir for docker imagesBartek Grzybowski1-2/+1
Docker_downloader module uses threads to concurrently save docker images to dest dir which creation is not guarded with any kind of thread lock object thus it could fail on os.makedirs as other thread could have already created that dir. Hence "exist_ok=True" opt is added to os.makedirs call so that it does not fail in such circumstances. Change-Id: I6e2d2c9864b71d038e7b2ed3018cdd3c01916956 Issue-ID: OOM-2631 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-12Support setting ansible docker image name from env variableBartek Grzybowski1-1/+4
Change-Id: Ie864f8e12bb9eac02a901d93c870c4679aedba94 Issue-ID: OOM-2625 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-12Upgrade nfs-utils package versionBartek Grzybowski1-1/+1
Change-Id: Ie824d8be21269b3c1ba233c6450ddab617f0159e Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-12Merge changes from topic "OOM-2623"Bartek Grzybowski1-19/+83
* changes: Abort if helm process failed to spawn Add feature to set custom helm repository server port Override oom-cert-service docker container name Setup temporary helm repository
2020-11-12Abort if helm process failed to spawnBartek Grzybowski1-0/+10
Change-Id: I930d3ca4c3d9ab49286a38c0ea298abe807ac781 Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-12Add feature to set custom helm repository server portBartek Grzybowski1-6/+46
Change-Id: Ia273290ce661c2e4887e16a3a323a7349c609546 Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-10Add precise operating system package requirementsMarcin Wilk1-1/+1
In order to make sure that kubernetes nodes will be installed with the required software packages before the actual ONAP installation, the more specific requirements have been added to the Installation Guide. Issue-ID: OOM-2627 Change-Id: I4f9e2a5aed969563f94c360e59f034f5f8995f52 Signed-off-by: Marcin Wilk <m.wilk@samsung.com>
2020-11-04Override oom-cert-service docker container nameBartek Grzybowski1-2/+6
Container name for certificate generation tool is hardcoded as "generate-certs" hence multiple builds couldn't run in parallel. This change overrides DOCKER_CONTAINER oom-cert-service makefile variable changing the container name effectively. Change-Id: I397ab7f3b04d35070cfb492ca482521ee10159fa Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-04Setup temporary helm repositoryBartek Grzybowski1-13/+23
A temporary helm repository will be created for the process of preparing data list and removed afterwards. This allows setting a separate working helm repo not affecting system wide configuration. Change-Id: I775e28b7c5f0e9b5259588032346ff392f1b1803 Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-04Merge "Update package versions"Bartek Grzybowski1-3/+2
2020-10-30Update package versionsBartek Grzybowski1-3/+2
Drop packages that are downloaded as dependencies of others anyway Dependencies of container-selinux: --> Processing Dependency: policycoreutils-python for package: 2:container-selinux-2.119.2-1.911c772.el7_8.noarch --> Processing Dependency: audit-libs-python >= 2.1.3-4 for package: policycoreutils-python-2.5-34.el7.x86_64 --> Processing Dependency: checkpolicy for package: policycoreutils-python-2.5-34.el7.x86_64 Dependencies of nfs-utils: --> Processing Dependency: gssproxy >= 0.7.0-3 for package: 1:nfs-utils-1.3.0-0.66.el7_8.x86_64 Change-Id: Ia67399685af0205474fa21fbc1fe3ec7eea261bb Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-30Fail the entrypoint script on any command failureBartek Grzybowski1-1/+2
Most importantly this will allowing propagating the failure to the wrapper script. Change-Id: I3f419f588e0f0fb5b459fa1d8e8d520b9f5c78d5 Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-30Clean target repository dir prior to downloading packagesBartek Grzybowski1-0/+3
This increases idempotency and allows avoiding side effects in cases where repo dir already contains images that are not on the list of required packages. Change-Id: Ieaa4e407ae7aacdc8d25440d90860cb880df09e2 Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-30Run docker container in foregroundBartek Grzybowski1-4/+2
This equals current behaviour of running in background and then attaching running container to print logs but will allow wrapper script to inherit exit code from entrypoint script. Change-Id: Ida447ef8024995de6cad81aa2dc857aec36e0d04 Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-28Support setting custom Docker container name suffixBartek Grzybowski1-9/+14
Change-Id: Ic3e4553442efd4c565c834a80184ff78e978cdba Issue-ID: OOM-2612 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-28Drop docker container cleanup statementBartek Grzybowski1-4/+0
Container is run with "--rm" option hence manual cleanup is not needed in any case. Change-Id: Iafe8287b8486abcd4a44fec102db8bfb89af1b63 Issue-ID: OOM-2612 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-28Fix English in comments; fix script synopsis textBartek Grzybowski2-63/+59
Change-Id: I6a67a8e675bdde8d9febc3edf8205c7516d979b8 Issue-ID: OOM-2612 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Use temporary Docker client configBartek Grzybowski1-14/+8
Change-Id: I2c864cbd553e377aa594badf4df58206e40e5794 Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Support publishing exposed container ports on custom host portsBartek Grzybowski1-3/+13
Change-Id: I3dcd47932821a124906f8d125697ecbe21c259af Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Drop registry hosts simulationBartek Grzybowski1-27/+7
Instead of simulating all images original registry hostnames locally running Nexus instance IP address is used to simplify the whole procedre. Change-Id: I42de7e2bc177a9b784090aece0b4ebe7d57912e7 Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Drop exposing additional portsBartek Grzybowski1-17/+0
As the default registry is the only one being set it's no more required to publish ports for each registry listed in images list file. Change-Id: I55a5e1f527bbc98dd4c1e1835c4218dc0fad4c1a Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Push all images to simulated Docker registry onlyBartek Grzybowski1-15/+15
In previous implementation all images were pushed to their original registries which were simulated locally. This change retags all images to locally simulated docker registry only and pushes them there accordingly. Created temporary tag is dropped at the end for order. Change-Id: If1b6633fdcc13d47c6e2b26792980320dce7f49a Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-26Support setting custom Nexus container nameBartek Grzybowski1-5/+21
Change-Id: I41098413b96ac08fe479167aa0f5d0c4a699ef33 Issue-ID: OOM-2605 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-21Bump the nfs-utils package versionBartek Grzybowski1-1/+1
Previous version was no longer available in repository Change-Id: I5bf1048c6ef6438b4cd50ad4231132da2f67432e Issue-ID: OOM-2604 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-16Set SKIP_LINT=true prior to building helm repositoryBartek Grzybowski1-0/+1
SKIP_LINT was already configured to be set in deployment stage in change 0d90cf8fe895e62b7343088ca9a017eff32e92dd but was missed to be set in build script. Change-Id: I599882eaa2e509fda6a41ca5bf5ff77a275adf93 Issue-ID: OOM-2599 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-09Ignore error if helm stable repo is already removedBartek Grzybowski1-1/+1
Fixes e941ec1 Change-Id: I8b5cb6a81998e32204d49c0f2630e1097f830aee Issue-ID: OOM-2591 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-08Remove helm "stable" repo while building chartsBartek Grzybowski1-0/+1
"Stable" repo is removed on targed deployment by a relevant ansible task, it should be removed in build stage as well. Change-Id: Ia89435e73c547e7d1cc4de19d635173307d083f4 Issue-ID: OOM-2591 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-09-24Create directory for output list file if it doesn't existBartek Grzybowski1-0/+5
Should the output list file directory passed as second param not exist the script would fail. Change-Id: I4586df54b42eba2ace49f6aaf03b68042354b44a Issue-ID: OOM-2578 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-09-23Workaround random application_dir removal failureBartek Grzybowski1-1/+1
In cases where --output-dir is set to a directory on a NFS share shutil fails to remove the application_dir. This WO will silence errors from rmtree routine. Change-Id: I0c5d06982f0ba2eb5b15276890b474afc46894e0 Issue-ID: OOM-2577 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-09-17Add feature to install shell autocompletion for kubectlBartek Grzybowski5-0/+30
Change-Id: I732dcd92144f9a8489a351047ab88b53ca36759e Issue-ID: OOM-2564 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-09-08Fix repository directory nameBartek Grzybowski1-1/+1
This fixes a regression bug introduced in 5907acf due to not all 'rhel' path elements updated. Change-Id: I21a7448aa4605f705cfb7a75030d69a0db04319f Issue-ID: OOM-2150 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-09-02Adding missing rpm packagesTomáš Levora1-0/+2
If target OS is installed from RHEL 7.6 DVD ISO, there are missing additional packages added by to the list by this patch. Issue-ID: OOM-2549 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com> Change-Id: I00c8fb3e8e6fb0f1a3879bd66a5c5e2542d321d3
2020-08-20Merge "Refactor helm-healer script"Tomáš Levora1-68/+122
2020-07-30Add automatic virtualenv provisioner for download and package scriptBartek Grzybowski3-0/+16
Change-Id: I072d514c7c2f03991caf6714dbdc0d2d7e5c8bb9 Issue-ID: INT-1670 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>